Apr 14 03:43:49 devstack cinder-volume[72720]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 03:43:49 devstack cinder-volume[72720]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 03:43:49 devstack cinder-volume[72720]: we strongly recommend against using it for new projects. Apr 14 03:43:49 devstack cinder-volume[72720]: If you are already using Eventlet, we recommend migrating to a different Apr 14 03:43:49 devstack cinder-volume[72720]: framework. For more detail see Apr 14 03:43:49 devstack cinder-volume[72720]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 03:43:49 devstack cinder-volume[72720]: import eventlet # noqa Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:43:51 devstack cinder-volume[72720]: INFO dbcounter [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Registered counter for database cinder Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_db.sqlalchemy.engines [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG dbcounter [-] [72720] Writer thread running {{(pid=72720) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:43:51 devstack cinder-volume[72720]: INFO cinder.rpc [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 03:43:51 devstack cinder-volume[72720]: INFO cinder.rpc [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_db.sqlalchemy.engines [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:43:51 devstack cinder-volume[72720]: INFO cinder.volume.manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Determined volume DB was empty at startup. Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG cinder.volume.manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72720) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 03:43:51 devstack cinder-volume[72720]: INFO cinder.volume.manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 03:43:51 devstack cinder-volume[72720]: WARNING stevedore.named [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 03:43:51 devstack cinder-volume[72720]: WARNING castellan.key_manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:43:51 devstack cinder-volume[72720]: WARNING cinder.keymgr.conf_key_mgr [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG cinder.volume.drivers.lvm [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72720) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 14 03:43:51 devstack cinder-volume[72720]: DEBUG oslo_concurrency.processutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72720) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_concurrency.processutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] CMD "cinder-rtstool verify" returned: 0 in 0.252s {{(pid=72720) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_db.sqlalchemy.engines [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:43:52 devstack cinder-volume[72720]: INFO cinder.rpc [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 03:43:52 devstack cinder-volume[72720]: INFO cinder.rpc [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 14 03:43:52 devstack cinder-volume[72720]: WARNING stevedore.named [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 03:43:52 devstack cinder-volume[72720]: WARNING castellan.key_manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:43:52 devstack cinder-volume[72720]: INFO cinder.volume.manager [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_db.sqlalchemy.engines [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:43:52 devstack cinder-volume[72720]: INFO oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Starting 1 workers Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Started child 72826 {{(pid=72720) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Full set of CONF: {{(pid=72720) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] ******************************************************************************** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Configuration options gathered from: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] ================================================================================ {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] allow_availability_zone_fallback = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] allow_compression_on_image_upload = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] allowed_direct_url_schemes = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] api_rate_limit = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] auth_strategy = keystone {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72826]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] az_cache_duration = 3600 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_availability_zone = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_host = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_stats_polling_interval = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backup_api_class = cinder.backup.api.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backup_name_template = backup-%s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backup_use_same_host = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backup_use_temp_snapshot = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] chap_password = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] chap_username = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_internal_tenant_project_id = c55806d1dc0f4f2ca7b86bc811c92a35 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_internal_tenant_user_id = 0a0ceb171afb461ca66e13f7c2c614db {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cloned_volume_same_az = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cluster = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] compression_format = gzip {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] compute_api_class = cinder.compute.nova.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] config_dir = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] config_source = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] control_exchange = openstack {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] debug = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] default_availability_zone = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] default_group_type = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] default_volume_type = lvmdriver-1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] disk_geometry = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_client_cert = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_client_cert_key = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_data_namespace = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_ssl_cert_path = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_ssl_cert_verify = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] driver_use_ssl = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] enable_force_upload = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] enable_new_services = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] enable_unsupported_driver = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] enforce_multipath_for_image_xfer = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] filter_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_api_insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_api_ssl_compression = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_ca_certificates_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_catalog_info = image:glance:publicURL {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_num_retries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance_request_timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] goodness_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] graceful_shutdown_timeout = 5 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] group_api_class = cinder.group.api.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] host = devstack {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_compress_on_upload = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_conversion_address_space_limit = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_conversion_cpu_limit = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_conversion_disable = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_upload_use_cinder_backend = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_upload_use_internal_tenant = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_volume_cache_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_volume_cache_max_count = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] image_volume_cache_max_size_gb = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] init_host_max_objects_retrieval = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] instance_format = [instance: %(uuid)s] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iscsi_target_flags = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iscsi_write_cache = on {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iser_helper = tgtadm {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iser_ip_address = 192.168.122.218 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iser_port = 3260 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_color = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_config_append = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_dir = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_options = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_rotate_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_rotate_interval_type = days {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] log_rotation_type = none {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] max_age = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] max_logfile_count = 30 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] max_logfile_size_mb = 200 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] max_over_subscription_ratio = 20.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] message_reap_interval = 86400 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] message_ttl = 2592000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] migration_create_volume_timeout_secs = 300 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] monkey_patch = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] monkey_patch_modules = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] my_ip = 192.168.122.218 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] no_snapshot_gb_quota = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] num_iser_scan_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] num_shell_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] num_volume_device_scan_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] nvmeof_conn_info_version = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] nvmet_ns_id = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] nvmet_port_id = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_max_limit = 1000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_ext_list = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_listen_port = 8776 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_use_ssl = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] osapi_volume_workers = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] per_volume_size_limit = -1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] periodic_fuzzy_delay = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] periodic_interval = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] public_endpoint = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] publish_errors = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_backup_gigabytes = 1000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_backups = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_gigabytes = 1000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_groups = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_snapshots = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] quota_volumes = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] rate_limit_burst = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] rate_limit_except_level = CRITICAL {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] rate_limit_interval = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] reinit_driver_count = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] replication_device = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] report_discard_supported = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] report_interval = 120 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] reservation_clean_interval = 86400 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] reservation_expire = 86400 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] reserved_image_namespaces = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] reserved_percentage = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] rpc_response_timeout = 120 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] run_external_periodic_tasks = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] scst_target_driver = iscsi {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] scst_target_iqn_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_down_time = 720 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] shell_completion = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] snapshot_name_template = snapshot-%s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] snapshot_same_host = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] split_loggers = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] state_path = /opt/stack/data/cinder {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] storage_availability_zone = nova {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] storage_protocol = iSCSI {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] syslog_log_facility = LOG_USER {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_helper = lioadm {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_ip_address = 192.168.122.218 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_port = 3260 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_protocol = iscsi {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] target_secondary_ip_addresses = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] trace_flags = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] transport_url = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] until_refresh = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_chap_auth = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_default_quota_class = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_journal = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_json = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_multipath_for_image_xfer = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_stderr = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] use_syslog = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] verify_glance_signatures = enabled {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_api_class = cinder.volume.api.API {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_backend_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_clear = zero {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_clear_ionice = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_clear_size = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_copy_bps_limit = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_dd_blocksize = 1M {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_name_template = volume-%s {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_service_inithost_offload = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volume_usage_audit_period = month {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] zoning_mode = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_concurrency.disable_process_locking = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.admin_password = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.admin_token = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.admin_user = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_port = 35357 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_protocol = https {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_section = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_type = password {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_uri = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.auth_version = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.cache = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.identity_uri = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.include_service_catalog = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.interface = public {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_password = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcache_username = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.region_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.service_type = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.backend = dogpile.cache.null {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.backend_argument = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.backend_expiration_time = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.config_prefix = cache.oslo {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.debug_cache_backend = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.enable_retry_client = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.enable_socket_keepalive = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.enforce_fips_mode = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.expiration_time = 600 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.hashclient_retry_attempts = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_dead_retry = 300 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_pool_maxsize = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_sasl_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.password = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.proxies = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.redis_db = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.redis_server = localhost:6379 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.retry_attempts = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.retry_delay = 0.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.socket_keepalive_count = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.socket_keepalive_idle = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.socket_keepalive_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.socket_timeout = 1.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.tls_allowed_ciphers = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.tls_cafile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.tls_certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.tls_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.tls_keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cache.username = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] coordination.backend_url = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.asyncio_connection = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.asyncio_slave_connection = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.backend = sqlalchemy {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.connection = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.connection_debug = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.connection_parameters = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.connection_recycle_time = 3600 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.connection_trace = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.db_inc_retry_interval = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.db_max_retries = 20 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.db_max_retry_interval = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.db_retry_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.max_overflow = 50 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.max_pool_size = 5 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.max_retries = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.mysql_wsrep_sync_wait = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.pool_timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.retry_interval = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.slave_connection = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.sqlite_synchronous = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.synchronous_reader = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] database.use_db_reconnect = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.connection_string = messaging:// {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.es_doc_type = notification {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.es_scroll_size = 10000 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.es_scroll_time = 2m {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.filter_error_trace = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.hmac_keys = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.sentinel_service_name = mymaster {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.socket_timeout = 0.1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.trace_requests = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler.trace_sqlalchemy = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler_jaeger.process_tags = {} {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler_jaeger.service_name_prefix = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] profiler_otlp.service_name_prefix = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.enforce_new_defaults = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72826]: INFO cinder.volume.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 14 03:43:52 devstack cinder-volume[72720]: WARNING oslo_config.cfg [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.enforce_scope = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.policy_default_rule = default {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.policy_file = policy.yaml {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.group = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.helper_command = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] privsep_osbrick.user = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.group = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.helper_command = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] cinder_sys_admin.user = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.auth_section = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.auth_type = password {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.cafile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.collect_timing = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.send_service_user_token = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.split_loggers = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] service_user.timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.auth_section = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.auth_type = password {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.collect_timing = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.region_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.split_loggers = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] glance.timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.backend_availability_zone = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.chap_password = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.chap_username = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.disk_geometry = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_client_cert = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_client_cert_key = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_data_namespace = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.driver_use_ssl = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.extra_capabilities = {} {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.filter_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.goodness_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iscsi_target_flags = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iscsi_write_cache = on {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iser_helper = tgtadm {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iser_port = 3260 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.lvm_share_target = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.lvm_type = auto {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.num_shell_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.replication_device = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.report_discard_supported = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.reserved_percentage = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_helper = tgtadm {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_port = 3260 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_protocol = iscsi {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.trace_flags = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.unique_fqdn_network = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.use_chap_auth = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_backend_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_clear = zero {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_clear_ionice = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_clear_size = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_reports.file_event_handler = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_reports.log_dir = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.backend_host = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.chap_password = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.chap_username = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.disk_geometry = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_client_cert = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.extra_capabilities = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.filter_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.goodness_function = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iser_helper = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iser_ip_address = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iser_port = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.lvm_share_target = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.lvm_type = auto {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.num_shell_tries = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.replication_device = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.report_discard_supported = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.reserved_percentage = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.scst_target_driver = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.storage_protocol = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_helper = lioadm {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_ip_address = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_port = 3260 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.trace_flags = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.use_chap_auth = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_clear = zero {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_clear_size = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] lvmdriver-1.volumes_dir = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_notifications.driver = [] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_notifications.retry = -1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] key_manager.fixed_key = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.barbican_api_version = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.barbican_endpoint = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.barbican_endpoint_type = public {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.barbican_region_name = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.cafile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.collect_timing = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.number_of_retries = 60 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.retry_delay = 1 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.send_service_user_token = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.split_loggers = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.verify_ssl = True {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican.verify_ssl_path = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.auth_section = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.auth_type = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.cafile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.certfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.collect_timing = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.insecure = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.keyfile = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.split_loggers = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] barbican_service_user.timeout = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.approle_role_id = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.approle_secret_id = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.kv_mountpoint = secret {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.kv_path = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.kv_version = 2 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.namespace = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.root_token_id = **** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.ssl_ca_crt_file = None {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.timeout = 60.0 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.use_ssl = False {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:43:52 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] ******************************************************************************** {{(pid=72720) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack sudo[72830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 14 03:43:52 devstack sudo[72830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:52 devstack sudo[72830]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:52 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:52 devstack sudo[72840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:52 devstack sudo[72840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:53 devstack sudo[72840]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.515s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:43:53 devstack cinder-volume[72826]: INFO cinder.brick.local_dev.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:53 devstack sudo[73064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:43:53 devstack sudo[73064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:53 devstack sudo[73064]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG cinder.brick.local_dev.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72826) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 14 03:43:53 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:53 devstack sudo[73259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:53 devstack sudo[73259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:54 devstack sudo[73259]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:54 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.807s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:54 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:54 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:54 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:54 devstack sudo[73430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:54 devstack sudo[73430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:55 devstack sudo[73430]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:55 devstack sudo[73522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 14 03:43:55 devstack sudo[73522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:55 devstack sudo[73522]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.435s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:55 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:55 devstack sudo[73525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:43:55 devstack sudo[73525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:56 devstack sudo[73525]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:56 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:56 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:56 devstack sudo[73528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:43:56 devstack sudo[73528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:56 devstack sudo[73528]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:56 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:56 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:56 devstack sudo[73533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:43:56 devstack sudo[73533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:57 devstack sudo[73533]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:57 devstack sudo[73539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:57 devstack sudo[73539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:57 devstack sudo[73539]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:57 devstack sudo[73545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:57 devstack sudo[73545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:57 devstack sudo[73545]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:57 devstack cinder-volume[72826]: INFO cinder.volume.drivers.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:57 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:58 devstack sudo[73551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:58 devstack sudo[73551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:58 devstack sudo[73551]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:58 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.542s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:58 devstack cinder-volume[72826]: DEBUG cinder.volume.drivers.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Updating volume stats {{(pid=72826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 03:43:58 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:58 devstack sudo[73590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:43:58 devstack sudo[73590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:58 devstack sudo[73590]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:58 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:58 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:59 devstack sudo[73678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:43:59 devstack sudo[73678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:59 devstack sudo[73678]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:59 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:59 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:59 devstack sudo[73763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:43:59 devstack sudo[73763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:43:59 devstack sudo[73763]: pam_unix(sudo:session): session closed for user root Apr 14 03:43:59 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:43:59 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:43:59 devstack sudo[73819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:43:59 devstack sudo[73819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:00 devstack sudo[73819]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:00 devstack cinder-volume[72826]: INFO cinder.volume.driver [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Driver hasn't implemented _init_vendor_properties() Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG cinder.volume.driver [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72826) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG oslo_db.sqlalchemy.engines [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG dbcounter [-] [72826] Writer thread running {{(pid=72826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG cinder.db.sqlalchemy.api [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Building query based on filter {{(pid=72826) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG cinder.image.image_utils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72826) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 03:44:00 devstack cinder-volume[72826]: INFO cinder.keymgr.migration [None req-49818d8a-0e77-4d42-b038-f6d3273d6a20 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG cinder.volume.drivers.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Updating volume stats {{(pid=72826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:00 devstack sudo[73823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:44:00 devstack sudo[73823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:00 devstack sudo[73823]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:00 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:00 devstack sudo[73830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:44:00 devstack sudo[73830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:01 devstack sudo[73830]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:01 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:01 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:01 devstack sudo[73833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:44:01 devstack sudo[73833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:01 devstack sudo[73833]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:01 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:01 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:01 devstack sudo[73837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:44:01 devstack sudo[73837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:02 devstack cinder-volume[72720]: DEBUG dbcounter [-] [72720] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72720) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:44:02 devstack sudo[73837]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG cinder.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Notifying Schedulers of capabilities ... {{(pid=72826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:02 devstack cinder-volume[72826]: INFO cinder.volume.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Driver initialization completed successfully. Apr 14 03:44:02 devstack cinder-volume[72826]: INFO cinder.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Initiating service 2 cleanup Apr 14 03:44:02 devstack cinder-volume[72826]: INFO cinder.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Service 2 cleanup completed. Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG cinder.service [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Creating RPC server for service cinder-volume {{(pid=72826) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG cinder.service [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72826) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 03:44:02 devstack cinder-volume[72826]: INFO cinder.volume.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG cinder.volume.drivers.lvm [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Updating volume stats {{(pid=72826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:02 devstack sudo[73842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:44:02 devstack sudo[73842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:02 devstack sudo[73842]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:02 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:02 devstack sudo[73850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:44:02 devstack sudo[73850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:03 devstack sudo[73850]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:03 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:03 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:03 devstack sudo[73854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:44:03 devstack sudo[73854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:03 devstack sudo[73854]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:03 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:03 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:44:03 devstack sudo[73911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:44:03 devstack sudo[73911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:44:04 devstack sudo[73911]: pam_unix(sudo:session): session closed for user root Apr 14 03:44:04 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:44:04 devstack cinder-volume[72826]: INFO cinder.volume.manager [None req-05532853-da66-4573-b0a4-bbc55011fa63 None None] Driver post RPC initialization completed successfully. Apr 14 03:44:14 devstack cinder-volume[72826]: DEBUG dbcounter [-] [72826] Writing DB stats cinder:SELECT=5 {{(pid=72826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:44:14 devstack cinder-volume[72826]: DEBUG dbcounter [-] [72826] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:45:33 devstack cinder-volume[72826]: DEBUG oslo_service.periodic_task [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:45:33 devstack cinder-volume[72826]: DEBUG cinder.volume.drivers.lvm [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Updating volume stats {{(pid=72826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 03:45:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:45:33 devstack sudo[78900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:45:33 devstack sudo[78900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:45:33 devstack sudo[78900]: pam_unix(sudo:session): session closed for user root Apr 14 03:45:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:45:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:45:33 devstack sudo[78903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:45:33 devstack sudo[78903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:45:34 devstack sudo[78903]: pam_unix(sudo:session): session closed for user root Apr 14 03:45:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:45:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:45:34 devstack sudo[78906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:45:34 devstack sudo[78906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:45:34 devstack sudo[78906]: pam_unix(sudo:session): session closed for user root Apr 14 03:45:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:45:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:45:34 devstack sudo[78909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:45:34 devstack sudo[78909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:45:35 devstack sudo[78909]: pam_unix(sudo:session): session closed for user root Apr 14 03:45:35 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:45:35 devstack cinder-volume[72826]: DEBUG cinder.manager [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Notifying Schedulers of capabilities ... {{(pid=72826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:46:14 devstack cinder-volume[72826]: DEBUG dbcounter [-] [72826] Writing DB stats cinder:SELECT=1 {{(pid=72826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:46:14 devstack cinder-volume[72826]: DEBUG dbcounter [-] [72826] Writing DB stats cinder:UPDATE=1 {{(pid=72826) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:46:33 devstack cinder-volume[72826]: DEBUG oslo_service.periodic_task [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:46:33 devstack cinder-volume[72826]: DEBUG cinder.volume.drivers.lvm [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Updating volume stats {{(pid=72826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 03:46:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:46:33 devstack sudo[80788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 03:46:33 devstack sudo[80788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:46:33 devstack sudo[80788]: pam_unix(sudo:session): session closed for user root Apr 14 03:46:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:46:33 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:46:33 devstack sudo[80791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:46:33 devstack sudo[80791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:46:34 devstack sudo[80791]: pam_unix(sudo:session): session closed for user root Apr 14 03:46:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:46:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:46:34 devstack sudo[80812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 03:46:34 devstack sudo[80812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:46:34 devstack sudo[80812]: pam_unix(sudo:session): session closed for user root Apr 14 03:46:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:46:34 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:46:34 devstack sudo[80836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 03:46:34 devstack sudo[80836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:46:35 devstack sudo[80836]: pam_unix(sudo:session): session closed for user root Apr 14 03:46:35 devstack cinder-volume[72826]: DEBUG oslo_concurrency.processutils [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:46:35 devstack cinder-volume[72826]: DEBUG cinder.manager [None req-3de7f10d-d60c-4032-9788-27f0c7ba7099 None None] Notifying Schedulers of capabilities ... {{(pid=72826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:47:20 devstack cinder-volume[72720]: INFO oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Caught SIGTERM, stopping children Apr 14 03:47:20 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Acquiring lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:20 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Acquired lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:20 devstack cinder-volume[72720]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Releasing lock "singleton_lock" {{(pid=72720) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:20 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Stop services. {{(pid=72720) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 14 03:47:20 devstack cinder-volume[72720]: DEBUG oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Killing children. {{(pid=72720) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 14 03:47:20 devstack cinder-volume[72720]: INFO oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Waiting on 1 children to exit Apr 14 03:47:22 devstack cinder-volume[72826]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Acquiring lock "singleton_lock" {{(pid=72826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:22 devstack cinder-volume[72826]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Acquired lock "singleton_lock" {{(pid=72826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:22 devstack cinder-volume[72826]: DEBUG oslo_concurrency.lockutils [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Releasing lock "singleton_lock" {{(pid=72826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:22 devstack cinder-volume[72826]: WARNING amqp [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 03:47:22 devstack cinder-volume[72826]: WARNING amqp [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 03:47:22 devstack cinder-volume[72720]: INFO oslo_service.backend._eventlet.service [None req-05a04340-986b-4605-b4ca-9e042d856931 None None] Child 72826 exited with status 0 Apr 14 03:47:22 devstack cinder-volume[81874]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 03:47:22 devstack cinder-volume[81874]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 03:47:22 devstack cinder-volume[81874]: we strongly recommend against using it for new projects. Apr 14 03:47:22 devstack cinder-volume[81874]: If you are already using Eventlet, we recommend migrating to a different Apr 14 03:47:22 devstack cinder-volume[81874]: framework. For more detail see Apr 14 03:47:22 devstack cinder-volume[81874]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 03:47:22 devstack cinder-volume[81874]: import eventlet # noqa Apr 14 03:47:24 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:24 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:24 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:25 devstack cinder-volume[81874]: INFO dbcounter [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Registered counter for database cinder Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_db.sqlalchemy.engines [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG dbcounter [-] [81874] Writer thread running {{(pid=81874) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:47:25 devstack cinder-volume[81874]: INFO cinder.rpc [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 03:47:25 devstack cinder-volume[81874]: INFO cinder.rpc [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_db.sqlalchemy.engines [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:25 devstack cinder-volume[81874]: INFO cinder.volume.manager [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Determined volume DB was empty at startup. Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG cinder.volume.manager [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81874) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 03:47:25 devstack cinder-volume[81874]: INFO cinder.volume.manager [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 03:47:25 devstack cinder-volume[81874]: WARNING stevedore.named [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 03:47:25 devstack cinder-volume[81874]: WARNING castellan.key_manager [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:47:25 devstack cinder-volume[81874]: WARNING cinder.keymgr.conf_key_mgr [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:47:25 devstack cinder-volume[81874]: INFO cinder.volume.manager [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_db.sqlalchemy.engines [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:25 devstack cinder-volume[81874]: INFO oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Starting 1 workers Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Started child 81992 {{(pid=81874) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Full set of CONF: {{(pid=81874) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] ******************************************************************************** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Configuration options gathered from: {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] ================================================================================ {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] allow_availability_zone_fallback = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] allow_compression_on_image_upload = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] allowed_direct_url_schemes = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] api_rate_limit = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] auth_strategy = keystone {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_availability_zone = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_host = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_stats_polling_interval = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backup_api_class = cinder.backup.api.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backup_name_template = backup-%s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backup_use_same_host = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backup_use_temp_snapshot = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] chap_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] chap_username = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_internal_tenant_project_id = c55806d1dc0f4f2ca7b86bc811c92a35 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_internal_tenant_user_id = 0a0ceb171afb461ca66e13f7c2c614db {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cluster = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] compression_format = gzip {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] compute_api_class = cinder.compute.nova.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] config_dir = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] config_source = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] control_exchange = openstack {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] debug = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] default_availability_zone = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] default_group_type = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81992]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] default_volume_type = QuobyteHD {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] disk_geometry = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_client_cert = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_client_cert_key = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_data_namespace = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_ssl_cert_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_ssl_cert_verify = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] driver_use_ssl = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] enable_new_services = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] enable_unsupported_driver = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] enabled_backends = ['QuobyteHD'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] enforce_multipath_for_image_xfer = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] filter_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_api_insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_api_ssl_compression = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_ca_certificates_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_catalog_info = image:glance:publicURL {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_num_retries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance_request_timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] goodness_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] graceful_shutdown_timeout = 5 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] group_api_class = cinder.group.api.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] host = devstack {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_compress_on_upload = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_conversion_address_space_limit = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_conversion_cpu_limit = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_conversion_disable = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_upload_use_cinder_backend = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_upload_use_internal_tenant = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_volume_cache_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_volume_cache_max_count = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] image_volume_cache_max_size_gb = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] init_host_max_objects_retrieval = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] instance_format = [instance: %(uuid)s] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iscsi_target_flags = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iscsi_write_cache = on {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iser_helper = tgtadm {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iser_ip_address = 192.168.122.218 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iser_port = 3260 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_color = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_config_append = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_dir = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_options = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_rotate_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_rotate_interval_type = days {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] log_rotation_type = none {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] max_age = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] max_logfile_count = 30 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] max_logfile_size_mb = 200 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] max_over_subscription_ratio = 20.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] message_reap_interval = 86400 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] message_ttl = 2592000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] migration_create_volume_timeout_secs = 300 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] monkey_patch = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] monkey_patch_modules = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] my_ip = 192.168.122.218 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] no_snapshot_gb_quota = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] num_iser_scan_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] num_shell_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] num_volume_device_scan_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] nvmeof_conn_info_version = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] nvmet_ns_id = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] nvmet_port_id = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_max_limit = 1000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_ext_list = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_listen_port = 8776 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_use_ssl = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] osapi_volume_workers = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] per_volume_size_limit = -1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] periodic_fuzzy_delay = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] periodic_interval = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] public_endpoint = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] publish_errors = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_backup_gigabytes = 1000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_backups = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_gigabytes = 1000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_groups = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_snapshots = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] quota_volumes = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] rate_limit_burst = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] rate_limit_except_level = CRITICAL {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] rate_limit_interval = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] reinit_driver_count = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] replication_device = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] report_discard_supported = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] report_interval = 120 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] reservation_clean_interval = 86400 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] reservation_expire = 86400 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] reserved_image_namespaces = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] reserved_percentage = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] rpc_response_timeout = 120 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] run_external_periodic_tasks = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] scst_target_driver = iscsi {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] scst_target_iqn_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_down_time = 720 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] shell_completion = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] snapshot_name_template = snapshot-%s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] split_loggers = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] state_path = /opt/stack/data/cinder {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] storage_availability_zone = nova {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] storage_protocol = iSCSI {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] syslog_log_facility = LOG_USER {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_helper = lioadm {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_ip_address = 192.168.122.218 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_port = 3260 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_protocol = iscsi {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] target_secondary_ip_addresses = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] trace_flags = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] transport_url = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] until_refresh = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_chap_auth = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_default_quota_class = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_journal = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_json = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_multipath_for_image_xfer = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_stderr = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] use_syslog = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] verify_glance_signatures = enabled {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_api_class = cinder.volume.api.API {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_backend_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_clear = zero {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_clear_ionice = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_clear_size = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_copy_bps_limit = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_dd_blocksize = 1M {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_name_template = volume-%s {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_service_inithost_offload = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volume_usage_audit_period = month {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] zoning_mode = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_concurrency.disable_process_locking = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.admin_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.admin_token = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.admin_user = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_port = 35357 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_protocol = https {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_section = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_type = password {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_uri = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.auth_version = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.cache = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.identity_uri = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.include_service_catalog = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.interface = public {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_password = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcache_username = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.region_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.service_type = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.backend = dogpile.cache.null {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.backend_argument = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.backend_expiration_time = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.config_prefix = cache.oslo {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.debug_cache_backend = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.enable_retry_client = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.enable_socket_keepalive = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.enforce_fips_mode = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.expiration_time = 600 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.hashclient_retry_attempts = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_dead_retry = 300 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_pool_maxsize = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_sasl_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.proxies = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.redis_db = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.redis_server = localhost:6379 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.retry_attempts = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.retry_delay = 0.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.socket_keepalive_count = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.socket_keepalive_idle = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.socket_keepalive_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.socket_timeout = 1.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.tls_allowed_ciphers = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.tls_cafile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.tls_certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.tls_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.tls_keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cache.username = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] coordination.backend_url = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.asyncio_connection = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.asyncio_slave_connection = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.backend = sqlalchemy {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.connection = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.connection_debug = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.connection_parameters = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.connection_recycle_time = 3600 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.connection_trace = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.db_inc_retry_interval = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.db_max_retries = 20 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.db_max_retry_interval = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.db_retry_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.max_overflow = 50 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.max_pool_size = 5 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.max_retries = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.mysql_wsrep_sync_wait = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.pool_timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.retry_interval = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.slave_connection = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.sqlite_synchronous = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.synchronous_reader = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] database.use_db_reconnect = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.connection_string = messaging:// {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.es_doc_type = notification {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.es_scroll_size = 10000 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.es_scroll_time = 2m {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.filter_error_trace = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.hmac_keys = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.sentinel_service_name = mymaster {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.socket_timeout = 0.1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.trace_requests = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler.trace_sqlalchemy = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler_jaeger.process_tags = {} {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler_jaeger.service_name_prefix = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] profiler_otlp.service_name_prefix = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.enforce_new_defaults = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: WARNING oslo_config.cfg [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.enforce_scope = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.policy_default_rule = default {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.policy_file = policy.yaml {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.group = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.helper_command = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] privsep_osbrick.user = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.group = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.helper_command = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] cinder_sys_admin.user = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.auth_section = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.auth_type = password {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.cafile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.collect_timing = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.send_service_user_token = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.split_loggers = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] service_user.timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.auth_section = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.auth_type = password {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.collect_timing = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.region_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.split_loggers = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] glance.timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.backend_availability_zone = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.chap_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.chap_username = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.disk_geometry = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_client_cert = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_client_cert_key = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_data_namespace = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.driver_use_ssl = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.extra_capabilities = {} {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.filter_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.goodness_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iscsi_target_flags = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iscsi_write_cache = on {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iser_helper = tgtadm {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iser_port = 3260 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_host = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_login = admin {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_mount_options = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_private_key = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_share_path = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.num_shell_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.quobyte_volume_url = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.replication_device = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.report_discard_supported = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.reserved_percentage = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_helper = tgtadm {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_port = 3260 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_protocol = iscsi {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.trace_flags = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.unique_fqdn_network = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.use_chap_auth = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_backend_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_clear = zero {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_clear_ionice = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_clear_size = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_reports.file_event_handler = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_reports.log_dir = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.backend_availability_zone = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.backend_host = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.chap_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.chap_username = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.chiscsi_conf = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.disk_geometry = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_client_cert = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_data_namespace = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.driver_use_ssl = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.extra_capabilities = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.filter_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.goodness_function = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iser_helper = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iser_ip_address = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iser_port = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.iser_target_prefix = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_host = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_login = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_mount_options = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_password = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_private_key = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_share_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_ssh_port = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.num_shell_tries = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.nvmet_port_id = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.replication_device = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.report_discard_supported = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.reserved_percentage = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.scst_target_driver = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.storage_protocol = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_helper = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_ip_address = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_port = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_prefix = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_protocol = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.trace_flags = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.use_chap_auth = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_clear = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_clear_size = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] QuobyteHD.volumes_dir = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81992]: INFO cinder.volume.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.remotefs [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81992) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_notifications.driver = [] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_notifications.retry = -1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] key_manager.fixed_key = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.barbican_api_version = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.barbican_endpoint = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.barbican_endpoint_type = public {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.barbican_region_name = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.cafile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.collect_timing = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.number_of_retries = 60 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.retry_delay = 1 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.send_service_user_token = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.split_loggers = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.verify_ssl = True {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican.verify_ssl_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.auth_section = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.auth_type = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.cafile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.certfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.collect_timing = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.insecure = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.keyfile = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.split_loggers = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] barbican_service_user.timeout = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.approle_role_id = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.approle_secret_id = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.kv_mountpoint = secret {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.kv_path = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.kv_version = 2 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.namespace = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.root_token_id = **** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.ssl_ca_crt_file = None {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.timeout = 60.0 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.use_ssl = False {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:25 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] ******************************************************************************** {{(pid=81874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81992) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 14 03:47:25 devstack cinder-volume[81992]: WARNING cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 14 03:47:25 devstack cinder-volume[81992]: WARNING cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Running cmd (subprocess): mount.quobyte {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:25 devstack quobyte-client[81993]: Reading configuration file: /etc/quobyte/client.cfg Apr 14 03:47:25 devstack quobyte-client[81993]: Invalid parameters found, error: missing mount point. Apr 14 03:47:25 devstack quobyte-client[81993]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 14 03:47:25 devstack quobyte-client[81993]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=81992) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:25 devstack cinder-volume[81992]: INFO cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 ... Apr 14 03:47:25 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 -c /etc/quobyte/client-cinder.cfg {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:25 devstack sudo[81994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 -c /etc/quobyte/client-cinder.cfg Apr 14 03:47:25 devstack sudo[81994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:26 devstack sudo[81994]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.483s {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:26 devstack cinder-volume[81992]: INFO cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 succeeded Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=81992) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.508s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:26 devstack sudo[82063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:26 devstack sudo[82063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:26 devstack sudo[82063]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.383s {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:26 devstack cinder-volume[81992]: INFO cinder.volume.driver [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Driver hasn't implemented _init_vendor_properties() Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.volume.driver [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81992) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_db.sqlalchemy.engines [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81992) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG dbcounter [-] [81992] Writer thread running {{(pid=81992) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.db.sqlalchemy.api [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Building query based on filter {{(pid=81992) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.image.image_utils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81992) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 03:47:26 devstack cinder-volume[81992]: INFO cinder.keymgr.migration [None req-9d7ce326-c65a-45a2-bf73-d94749bc513a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=81992) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=81992) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:26 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:26 devstack sudo[82066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:26 devstack sudo[82066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:27 devstack sudo[82066]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.374s {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG cinder.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Notifying Schedulers of capabilities ... {{(pid=81992) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:47:27 devstack cinder-volume[81992]: INFO cinder.volume.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Driver initialization completed successfully. Apr 14 03:47:27 devstack cinder-volume[81992]: INFO cinder.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Initiating service 3 cleanup Apr 14 03:47:27 devstack cinder-volume[81992]: INFO cinder.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Service 3 cleanup completed. Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG cinder.service [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Creating RPC server for service cinder-volume {{(pid=81992) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG cinder.service [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81992) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 03:47:27 devstack cinder-volume[81992]: INFO cinder.volume.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=81992) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG cinder.volume.drivers.quobyte [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=81992) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:27 devstack sudo[82071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:27 devstack sudo[82071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:27 devstack sudo[82071]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:27 devstack cinder-volume[81992]: DEBUG oslo_concurrency.processutils [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.424s {{(pid=81992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:27 devstack cinder-volume[81992]: INFO cinder.volume.manager [None req-ff42b881-44fc-43a7-b8b4-faa12cf90668 None None] Driver post RPC initialization completed successfully. Apr 14 03:47:29 devstack cinder-volume[81874]: INFO oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Caught SIGTERM, stopping children Apr 14 03:47:29 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Acquiring lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:29 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Acquired lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:29 devstack cinder-volume[81874]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Releasing lock "singleton_lock" {{(pid=81874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:29 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Stop services. {{(pid=81874) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 14 03:47:29 devstack cinder-volume[81874]: DEBUG oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Killing children. {{(pid=81874) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 14 03:47:29 devstack cinder-volume[81874]: INFO oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Waiting on 1 children to exit Apr 14 03:47:31 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Acquiring lock "singleton_lock" {{(pid=81992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:31 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Acquired lock "singleton_lock" {{(pid=81992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:31 devstack cinder-volume[81992]: DEBUG oslo_concurrency.lockutils [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Releasing lock "singleton_lock" {{(pid=81992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:31 devstack cinder-volume[81992]: WARNING amqp [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 03:47:31 devstack cinder-volume[81992]: WARNING amqp [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 03:47:31 devstack cinder-volume[81874]: INFO oslo_service.backend._eventlet.service [None req-9652b0d0-fe97-4926-9ad9-1833d7cc6a87 None None] Child 81992 exited with status 0 Apr 14 03:47:31 devstack cinder-volume[82211]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 03:47:31 devstack cinder-volume[82211]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 03:47:31 devstack cinder-volume[82211]: we strongly recommend against using it for new projects. Apr 14 03:47:31 devstack cinder-volume[82211]: If you are already using Eventlet, we recommend migrating to a different Apr 14 03:47:31 devstack cinder-volume[82211]: framework. For more detail see Apr 14 03:47:31 devstack cinder-volume[82211]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 03:47:31 devstack cinder-volume[82211]: import eventlet # noqa Apr 14 03:47:33 devstack cinder-volume[82211]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82211) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 03:47:33 devstack cinder-volume[82211]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82211) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 03:47:33 devstack cinder-volume[82211]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82211) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 03:47:33 devstack cinder-volume[82211]: INFO dbcounter [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Registered counter for database cinder Apr 14 03:47:33 devstack cinder-volume[82211]: DEBUG oslo_db.sqlalchemy.engines [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG dbcounter [-] [82211] Writer thread running {{(pid=82211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:47:34 devstack cinder-volume[82211]: INFO cinder.rpc [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 03:47:34 devstack cinder-volume[82211]: INFO cinder.rpc [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_db.sqlalchemy.engines [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:34 devstack cinder-volume[82211]: INFO cinder.volume.manager [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Determined volume DB was empty at startup. Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG cinder.volume.manager [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82211) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 03:47:34 devstack cinder-volume[82211]: WARNING stevedore.named [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 03:47:34 devstack cinder-volume[82211]: WARNING castellan.key_manager [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:47:34 devstack cinder-volume[82211]: WARNING cinder.keymgr.conf_key_mgr [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 03:47:34 devstack cinder-volume[82211]: INFO cinder.volume.manager [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_db.sqlalchemy.engines [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:34 devstack cinder-volume[82211]: INFO oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Starting 1 workers Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Started child 82370 {{(pid=82211) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Full set of CONF: {{(pid=82211) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] ******************************************************************************** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Configuration options gathered from: {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] ================================================================================ {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] allow_availability_zone_fallback = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] allow_compression_on_image_upload = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] allowed_direct_url_schemes = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] api_rate_limit = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] auth_strategy = keystone {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_availability_zone = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_host = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_stats_polling_interval = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backup_api_class = cinder.backup.api.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backup_name_template = backup-%s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backup_use_same_host = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backup_use_temp_snapshot = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] chap_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] chap_username = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_internal_tenant_project_id = c55806d1dc0f4f2ca7b86bc811c92a35 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_internal_tenant_user_id = 0a0ceb171afb461ca66e13f7c2c614db {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cluster = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] compression_format = gzip {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] compute_api_class = cinder.compute.nova.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] config_dir = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82370]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] config_source = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] control_exchange = openstack {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] debug = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] default_availability_zone = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] default_group_type = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] default_volume_type = QuobyteHD {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] disk_geometry = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_client_cert = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_client_cert_key = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_data_namespace = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_ssl_cert_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_ssl_cert_verify = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] driver_use_ssl = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] enable_new_services = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] enable_unsupported_driver = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] enabled_backends = ['QuobyteHD'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] enforce_multipath_for_image_xfer = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] filter_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_api_insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_api_ssl_compression = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_ca_certificates_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_catalog_info = image:glance:publicURL {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_num_retries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance_request_timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] goodness_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] graceful_shutdown_timeout = 5 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] group_api_class = cinder.group.api.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] host = devstack {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_compress_on_upload = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Starting volume driver QuobyteDriver (1.1.14) Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82370) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_conversion_address_space_limit = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_conversion_cpu_limit = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_conversion_disable = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_upload_use_cinder_backend = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_upload_use_internal_tenant = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_volume_cache_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_volume_cache_max_count = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] image_volume_cache_max_size_gb = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] init_host_max_objects_retrieval = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] instance_format = [instance: %(uuid)s] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iscsi_target_flags = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iscsi_write_cache = on {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iser_helper = tgtadm {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iser_ip_address = 192.168.122.218 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iser_port = 3260 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_color = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_config_append = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_dir = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_options = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_rotate_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_rotate_interval_type = days {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] log_rotation_type = none {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] max_age = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] max_logfile_count = 30 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] max_logfile_size_mb = 200 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] max_over_subscription_ratio = 20.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] message_reap_interval = 86400 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] message_ttl = 2592000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] migration_create_volume_timeout_secs = 300 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] monkey_patch = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] monkey_patch_modules = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] my_ip = 192.168.122.218 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] no_snapshot_gb_quota = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] num_iser_scan_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] num_shell_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] num_volume_device_scan_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] nvmeof_conn_info_version = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] nvmet_ns_id = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] nvmet_port_id = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_max_limit = 1000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_ext_list = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_listen = 0.0.0.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_listen_port = 8776 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_use_ssl = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] osapi_volume_workers = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] per_volume_size_limit = -1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] periodic_fuzzy_delay = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] periodic_interval = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] project_id_regex = [0-9a-f\-]+ {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] public_endpoint = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] publish_errors = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_backup_gigabytes = 1000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_backups = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_gigabytes = 1000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_groups = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_snapshots = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] quota_volumes = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] rate_limit_burst = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] rate_limit_except_level = CRITICAL {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] rate_limit_interval = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] reinit_driver_count = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] replication_device = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] report_discard_supported = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] report_interval = 120 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] reservation_clean_interval = 86400 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] reservation_expire = 86400 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] reserved_image_namespaces = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] reserved_percentage = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] rpc_response_timeout = 120 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] run_external_periodic_tasks = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] scst_target_driver = iscsi {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] scst_target_iqn_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_down_time = 720 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] shell_completion = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] snapshot_name_template = snapshot-%s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] split_loggers = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] state_path = /opt/stack/data/cinder {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] storage_availability_zone = nova {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] storage_protocol = iSCSI {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] syslog_log_facility = LOG_USER {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_helper = lioadm {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_ip_address = 192.168.122.218 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_port = 3260 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_protocol = iscsi {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] target_secondary_ip_addresses = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] trace_flags = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] transfer_api_class = cinder.transfer.api.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] transport_url = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82370) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 14 03:47:34 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 14 03:47:34 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] until_refresh = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_chap_auth = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_default_quota_class = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_journal = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_json = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_multipath_for_image_xfer = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Running cmd (subprocess): mount.quobyte {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_stderr = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] use_syslog = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] verify_glance_signatures = enabled {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_api_class = cinder.volume.api.API {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_backend_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_clear = zero {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_clear_ionice = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_clear_size = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_copy_bps_limit = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_dd_blocksize = 1M {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_name_template = volume-%s {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_service_inithost_offload = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volume_usage_audit_period = month {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] zoning_mode = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_concurrency.disable_process_locking = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.admin_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.admin_token = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.admin_user = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_admin_prefix = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_port = 35357 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_protocol = https {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_section = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_type = password {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_uri = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.auth_version = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.cache = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.identity_uri = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.include_service_catalog = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.interface = public {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_password = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcache_username = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.region_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.service_type = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.backend = dogpile.cache.null {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.backend_argument = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.backend_expiration_time = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.config_prefix = cache.oslo {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.debug_cache_backend = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.enable_retry_client = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.enable_socket_keepalive = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.enforce_fips_mode = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.expiration_time = 600 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.hashclient_retry_attempts = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_dead_retry = 300 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_pool_maxsize = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_sasl_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.proxies = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.redis_db = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.redis_server = localhost:6379 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.retry_attempts = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.retry_delay = 0.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.socket_keepalive_count = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.socket_keepalive_idle = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.socket_keepalive_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.socket_timeout = 1.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.tls_allowed_ciphers = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.tls_cafile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack quobyte-client[82388]: Reading configuration file: /etc/quobyte/client.cfg Apr 14 03:47:34 devstack quobyte-client[82388]: Invalid parameters found, error: missing mount point. Apr 14 03:47:34 devstack quobyte-client[82388]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 14 03:47:34 devstack quobyte-client[82388]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.tls_certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.tls_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.tls_keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cache.username = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] coordination.backend_url = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.asyncio_connection = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.asyncio_slave_connection = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.backend = sqlalchemy {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.connection = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.connection_debug = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.connection_parameters = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.connection_recycle_time = 3600 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.connection_trace = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.db_inc_retry_interval = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.db_max_retries = 20 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.db_max_retry_interval = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.db_retry_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.max_overflow = 50 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.max_pool_size = 5 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.max_retries = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.mysql_wsrep_sync_wait = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.pool_timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.retry_interval = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.slave_connection = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.sqlite_synchronous = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.synchronous_reader = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] database.use_db_reconnect = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.connection_string = messaging:// {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.es_doc_type = notification {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.es_scroll_size = 10000 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.es_scroll_time = 2m {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.filter_error_trace = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.hmac_keys = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.sentinel_service_name = mymaster {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.socket_timeout = 0.1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.trace_requests = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler.trace_sqlalchemy = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler_jaeger.process_tags = {} {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler_jaeger.service_name_prefix = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] profiler_otlp.service_name_prefix = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.enforce_new_defaults = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: WARNING oslo_config.cfg [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.enforce_scope = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.policy_default_rule = default {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.policy_file = policy.yaml {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_policy.remote_timeout = 60.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.group = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.helper_command = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] privsep_osbrick.user = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.group = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.helper_command = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] cinder_sys_admin.user = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.auth_section = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.auth_type = password {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.cafile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.collect_timing = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.send_service_user_token = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.split_loggers = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] service_user.timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.auth_section = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.auth_type = password {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.collect_timing = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.region_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.split_loggers = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] glance.timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.backend_availability_zone = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.chap_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.chap_username = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.disk_geometry = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_client_cert = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_client_cert_key = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_data_namespace = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.driver_use_ssl = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.extra_capabilities = {} {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.filter_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.goodness_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iscsi_target_flags = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iscsi_write_cache = on {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iser_helper = tgtadm {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iser_port = 3260 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_host = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_login = admin {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_mount_options = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_private_key = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_share_path = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_ssh_port = 22 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.num_shell_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.quobyte_volume_url = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.replication_device = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.report_discard_supported = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.reserved_percentage = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_helper = tgtadm {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_port = 3260 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_protocol = iscsi {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.trace_flags = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.unique_fqdn_network = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.use_chap_auth = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_backend_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_clear = zero {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_clear_ionice = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_clear_size = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_reports.file_event_handler = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_reports.log_dir = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack sudo[82392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.backend_availability_zone = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.backend_host = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.chap_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.chap_username = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.chiscsi_conf = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.disk_geometry = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_client_cert = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack sudo[82392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_data_namespace = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.driver_use_ssl = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.extra_capabilities = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.filter_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.goodness_function = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iscsi_target_flags = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iscsi_write_cache = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iser_helper = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iser_ip_address = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iser_port = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.iser_target_prefix = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_host = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_login = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_mount_options = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_password = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_private_key = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_share_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_ssh_port = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.num_shell_tries = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nvmet_ns_id = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.nvmet_port_id = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.replication_device = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.report_discard_supported = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.reserved_percentage = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.scst_target_driver = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.storage_protocol = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_helper = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_ip_address = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_port = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_prefix = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_protocol = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.trace_flags = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.unique_fqdn_network = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.use_chap_auth = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_clear = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_clear_ionice = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_clear_size = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] QuobyteHD.volumes_dir = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.ssl_version = {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_notifications.driver = [] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_notifications.retry = -1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] key_manager.fixed_key = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.barbican_api_version = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.barbican_endpoint = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.barbican_endpoint_type = public {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.barbican_region_name = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.cafile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.collect_timing = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.number_of_retries = 60 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.retry_delay = 1 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.send_service_user_token = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.split_loggers = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.verify_ssl = True {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican.verify_ssl_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.auth_section = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.auth_type = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.cafile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.certfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.collect_timing = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.insecure = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.keyfile = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.split_loggers = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] barbican_service_user.timeout = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.approle_role_id = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.approle_secret_id = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.kv_mountpoint = secret {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.kv_path = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.kv_version = 2 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.namespace = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.root_token_id = **** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.ssl_ca_crt_file = None {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.timeout = 60.0 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.use_ssl = False {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 03:47:34 devstack cinder-volume[82211]: DEBUG oslo_service.backend._eventlet.service [None req-648be41e-7d27-4701-b415-c46c3ca98f7e None None] ******************************************************************************** {{(pid=82211) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 03:47:34 devstack sudo[82392]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.598s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:34 devstack cinder-volume[82370]: INFO cinder.volume.driver [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Driver hasn't implemented _init_vendor_properties() Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.driver [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82370) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_db.sqlalchemy.engines [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writer thread running {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.db.sqlalchemy.api [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Building query based on filter {{(pid=82370) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82370) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.keymgr.migration [None req-0464c94d-746e-413f-98d1-f819381838b8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 03:47:35 devstack sudo[82443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:35 devstack sudo[82443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:35 devstack sudo[82443]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.404s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Driver initialization completed successfully. Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Initiating service 3 cleanup Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Service 3 cleanup completed. Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG cinder.service [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Creating RPC server for service cinder-volume {{(pid=82370) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG cinder.service [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82370) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:47:35 devstack sudo[82456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:47:35 devstack sudo[82456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:47:35 devstack sudo[82456]: pam_unix(sudo:session): session closed for user root Apr 14 03:47:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.396s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:47:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5072a54f-c9c2-4e9e-b3ab-0f1b3feed4ac None None] Driver post RPC initialization completed successfully. Apr 14 03:47:44 devstack cinder-volume[82211]: DEBUG dbcounter [-] [82211] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:47:45 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=2 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:47:45 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Flow 'volume_create_manager' (532f420c-9699-4a69-845d-a4f9a765b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75228a-3602-4cf9-b096-a1bbfec50c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75228a-3602-4cf9-b096-a1bbfec50c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1648616638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a89388-d2bb-418e-86eb-dce7d4a23da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3cffd1ba144757b3869ec4dc8f458e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:34Z,use_quota=True,user_id='b3af70a6a7ca4fc7a0d54169c06bf893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267686fe-ee1b-4c83-923e-7a1cf40c0a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267686fe-ee1b-4c83-923e-7a1cf40c0a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f16b9d-a2af-491b-b611-46771703872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f16b9d-a2af-491b-b611-46771703872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a89388-d2bb-418e-86eb-dce7d4a23da7', 'volume_name': 'volume-24a89388-d2bb-418e-86eb-dce7d4a23da7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e31a9-cd04-4efd-a355-1feddb6d38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e31a9-cd04-4efd-a355-1feddb6d38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7854102-22bf-41f8-9784-88f8eb2211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:34 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Volume 24a89388-d2bb-418e-86eb-dce7d4a23da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a89388-d2bb-418e-86eb-dce7d4a23da7', 'volume_size': 1} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1648616638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a89388-d2bb-418e-86eb-dce7d4a23da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3cffd1ba144757b3869ec4dc8f458e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:34Z,use_quota=True,user_id='b3af70a6a7ca4fc7a0d54169c06bf893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Creating volume 24a89388-d2bb-418e-86eb-dce7d4a23da7 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:48:34 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:48:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:34 devstack sudo[82918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 1073741824 Apr 14 03:48:34 devstack sudo[82918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:35 devstack sudo[82918]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 1073741824" returned: 0 in 1.433s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:35 devstack sudo[83248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 Apr 14 03:48:35 devstack sudo[83248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:36 devstack sudo[83248]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7" returned: 0 in 0.951s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7854102-22bf-41f8-9784-88f8eb2211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a89388-d2bb-418e-86eb-dce7d4a23da7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5b9bce-ce7c-4513-b23b-bb6092509314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:36 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Volume volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 (24a89388-d2bb-418e-86eb-dce7d4a23da7): created successfully Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5b9bce-ce7c-4513-b23b-bb6092509314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Flow 'volume_create_manager' (532f420c-9699-4a69-845d-a4f9a765b6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-42050299-19d9-4290-9374-14afe4538c79 tempest-DeleteServersTestJSON-1204053657 None] Created volume successfully. Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Flow 'volume_create_manager' (304ec443-5831-4a81-8bed-3b24239efc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fcab77-7d5e-45e9-a2b6-c8b213049313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fcab77-7d5e-45e9-a2b6-c8b213049313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-38346805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c482521-e030-4eed-aee9-7ca6c2830a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d0f79b1929444dac3d7fc0ba1139a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:43Z,use_quota=True,user_id='49678ac9a2884f82a723c9876ff15c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4fcdfb-4697-4988-8159-eb0d3fff5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4fcdfb-4697-4988-8159-eb0d3fff5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60813297-a641-4e18-86ec-9aebe7255114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60813297-a641-4e18-86ec-9aebe7255114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c482521-e030-4eed-aee9-7ca6c2830a7a', 'volume_name': 'volume-2c482521-e030-4eed-aee9-7ca6c2830a7a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4803d741-aa94-4b52-b60d-3aee5227623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4803d741-aa94-4b52-b60d-3aee5227623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358bf60-de5d-4881-ab8e-8226b296b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:43 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Volume 2c482521-e030-4eed-aee9-7ca6c2830a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c482521-e030-4eed-aee9-7ca6c2830a7a', 'volume_size': 1} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-38346805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c482521-e030-4eed-aee9-7ca6c2830a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d0f79b1929444dac3d7fc0ba1139a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:43Z,use_quota=True,user_id='49678ac9a2884f82a723c9876ff15c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Creating volume 2c482521-e030-4eed-aee9-7ca6c2830a7a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:48:43 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:48:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:43 devstack sudo[83311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a 1073741824 Apr 14 03:48:43 devstack sudo[83311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Flow 'volume_create_manager' (e36f542f-7c72-4474-b863-481a0d2bc47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc59a540-dcbc-4055-a7fc-1de8765d306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc59a540-dcbc-4055-a7fc-1de8765d306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:44Z,deleted=False,deleted_at=None,display_description='',display_name='c422dd95-13bc-4c46-9cfe-f9f1750ff8d4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34707879-b9fa-4eeb-990e-3dfec91a4212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ee6b904c304a3fae9d9227f70a1093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:44Z,use_quota=True,user_id='f272758b3bce458596b9dee96c604ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c211f4c-1eae-48d6-8d6a-64769fa6688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c211f4c-1eae-48d6-8d6a-64769fa6688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063810ff-d0df-4330-ad75-a18ed32d3442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063810ff-d0df-4330-ad75-a18ed32d3442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34707879-b9fa-4eeb-990e-3dfec91a4212', 'volume_name': 'volume-34707879-b9fa-4eeb-990e-3dfec91a4212', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c40599-da6b-454c-9426-c881ee8e8825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c40599-da6b-454c-9426-c881ee8e8825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d279003-2243-4ac9-9bfd-0755ff34fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume 34707879-b9fa-4eeb-990e-3dfec91a4212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34707879-b9fa-4eeb-990e-3dfec91a4212', 'volume_size': 1} Apr 14 03:48:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:45 devstack sudo[83311]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a 1073741824" returned: 0 in 2.078s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:45 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a Apr 14 03:48:45 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:46 devstack cinder-volume[82370]: WARNING py.warnings [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 14 03:48:46 devstack cinder-volume[82370]: .first() Apr 14 03:48:46 devstack cinder-volume[82370]: Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:46 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a" returned: 0 in 1.030s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] <== create_volume: return (3169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.171s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:48:44Z,deleted=False,deleted_at=None,display_description='',display_name='c422dd95-13bc-4c46-9cfe-f9f1750ff8d4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34707879-b9fa-4eeb-990e-3dfec91a4212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ee6b904c304a3fae9d9227f70a1093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:48:44Z,use_quota=True,user_id='f272758b3bce458596b9dee96c604ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Creating volume 34707879-b9fa-4eeb-990e-3dfec91a4212 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:48:46 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358bf60-de5d-4881-ab8e-8226b296b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c482521-e030-4eed-aee9-7ca6c2830a7a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706dc916-548c-4084-b8dd-3c52026fe9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:46 devstack sudo[83338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 1073741824 Apr 14 03:48:46 devstack sudo[83338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Volume volume-2c482521-e030-4eed-aee9-7ca6c2830a7a (2c482521-e030-4eed-aee9-7ca6c2830a7a): created successfully Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706dc916-548c-4084-b8dd-3c52026fe9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Flow 'volume_create_manager' (304ec443-5831-4a81-8bed-3b24239efc20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6e489bb6-e135-442f-b385-17a41acf9fa6 tempest-VolumesAdminNegativeTest-1322791283 None] Created volume successfully. Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Acquiring lock "cinder-2c482521-e030-4eed-aee9-7ca6c2830a7a-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "cinder-2c482521-e030-4eed-aee9-7ca6c2830a7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Acquiring lock "cinder-quobyte-2c482521-e030-4eed-aee9-7ca6c2830a7a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "cinder-quobyte-2c482521-e030-4eed-aee9-7ca6c2830a7a" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:48:48 devstack sudo[83338]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:48 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgoxksb6a/privsep.sock'] Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 1073741824" returned: 0 in 1.795s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:48 devstack sudo[83366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgoxksb6a/privsep.sock Apr 14 03:48:48 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:48 devstack sudo[83386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 Apr 14 03:48:48 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:49 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212" returned: 0 in 1.275s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] <== create_volume: return (3135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:48:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.143s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.716s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d279003-2243-4ac9-9bfd-0755ff34fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34707879-b9fa-4eeb-990e-3dfec91a4212', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633ffc78-ca2f-4b05-a81c-a5a1f875150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 14 03:48:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume volume-34707879-b9fa-4eeb-990e-3dfec91a4212 (34707879-b9fa-4eeb-990e-3dfec91a4212): created successfully Apr 14 03:48:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633ffc78-ca2f-4b05-a81c-a5a1f875150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:48:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Flow 'volume_create_manager' (e36f542f-7c72-4474-b863-481a0d2bc47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:48:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-b557f3a6-e8ca-40bb-b4f6-7b6e8891275a tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Created volume successfully. Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 03:48:50 devstack cinder-volume[82370]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 14 03:48:51 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:51 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Spawned new privsep daemon via rootwrap Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Accepted privsep connection to /tmp/tmpgoxksb6a/privsep.sock {{(pid=82370) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 14 03:48:51 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 03:48:51 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 03:48:51 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 14 03:48:51 devstack cinder-volume[82370]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83434 Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c1938e-34f8-48ae-9a70-41fe8ab307c6]: (2,) {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:48:51 devstack cinder-volume[82370]: WARNING oslo_privsep.priv_context [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] privsep daemon already running Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb2532-e31c-4fad-9ca4-d31b7859516c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad156fa-0207-4687-8edd-77d0002150c1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:51 devstack sudo[83447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a Apr 14 03:48:51 devstack sudo[83447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:51 devstack sudo[83446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 Apr 14 03:48:51 devstack sudo[83446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:52 devstack sudo[83446]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7" returned: 0 in 0.896s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.370s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.843s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:52 devstack sudo[83447]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a" returned: 0 in 0.941s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9ac3a-9a97-4963-b864-aa172b2b11fb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:52 devstack sudo[83472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a Apr 14 03:48:52 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2', 'name': 'volume-24a89388-d2bb-418e-86eb-dce7d4a23da7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c87ae17-75fb-4188-8944-b399ddd6db40', 'enforce_multipath': True} {{(pid=82370) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 03:48:52 devstack sudo[83473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 Apr 14 03:48:52 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-f69554ef-ed42-4e6c-aae0-49692c103972 req-849a0b8a-a2fc-4d8b-bcae-274b3bf85679 tempest-DeleteServersTestJSON-1204053657 None] attachment_update completed successfully. Apr 14 03:48:53 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2c482521-e030-4eed-aee9-7ca6c2830a7a" returned: 0 in 0.803s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "cinder-quobyte-2c482521-e030-4eed-aee9-7ca6c2830a7a" released by "delete_volume" :: held 4.620s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:48:53 devstack cinder-volume[82370]: WARNING cinder.quota [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:48:53 devstack cinder-volume[82370]: WARNING cinder.quota [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Created reservations ['ba00d8c8-483d-4f93-8538-2cc40757767f', '875b2376-22f2-4e50-aa54-0ef7ba618905', 'f68435d0-f340-428a-af19-4b0a483a0f99', '4da3b49a-6176-4bc8-887c-a0b6483c996a'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:48:53 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212" returned: 0 in 1.026s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.105s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:53 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2', 'name': 'volume-34707879-b9fa-4eeb-990e-3dfec91a4212', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88fc6401-8fec-4970-bb8b-277f7f5e5e8e', 'enforce_multipath': True} {{(pid=82370) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 03:48:53 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:48:53 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:53 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-63c22623-2e4c-4fab-8c30-150208d1f86b req-0715dae3-514d-4ec5-a948-57f224e5228d tempest-ServerBootFromVolumeStableRescueTest-904746739 None] attachment_update completed successfully. Apr 14 03:48:54 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.599s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:54 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:48:54 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Deleted volume successfully. Apr 14 03:48:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0704dd41-acd9-4ff9-9d40-0cce9417b3b0 tempest-VolumesAdminNegativeTest-1322791283 None] Lock "cinder-2c482521-e030-4eed-aee9-7ca6c2830a7a-delete_volume" released by "delete_volume" :: held 5.683s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:48:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:48:58 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:48:58 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:48:59 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Apr 14 03:48:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.038s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:48:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-1af7a584-0d04-4e9f-9e09-e151220e2b40 req-0a565be3-a3a9-4440-a6e2-55c462c34dae tempest-DeleteServersTestJSON-1204053657 None] Terminate volume connection completed successfully. Apr 14 03:49:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-1af7a584-0d04-4e9f-9e09-e151220e2b40 req-0a565be3-a3a9-4440-a6e2-55c462c34dae tempest-DeleteServersTestJSON-1204053657 None] Deleting attachment 2c87ae17-75fb-4188-8944-b399ddd6db40. {{(pid=82370) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "cinder-24a89388-d2bb-418e-86eb-dce7d4a23da7-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "cinder-24a89388-d2bb-418e-86eb-dce7d4a23da7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "cinder-quobyte-24a89388-d2bb-418e-86eb-dce7d4a23da7" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "cinder-quobyte-24a89388-d2bb-418e-86eb-dce7d4a23da7" acquired by "delete_volume" :: waited 0.093s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1a55f-58df-40a2-894a-dae0245fe05e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:06 devstack sudo[84075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 Apr 14 03:49:06 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:07 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7" returned: 0 in 0.635s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:07 devstack sudo[84081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7 Apr 14 03:49:07 devstack sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:07 devstack sudo[84081]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-24a89388-d2bb-418e-86eb-dce7d4a23da7" returned: 0 in 0.518s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "cinder-quobyte-24a89388-d2bb-418e-86eb-dce7d4a23da7" released by "delete_volume" :: held 1.199s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Created reservations ['29c85ffe-8bd4-42d5-b945-61e28270f5b1', 'c7c0eec3-c570-4c02-b130-df3c879c0869', '34fe5246-c48b-44c6-a885-e937b6a79496', '72dad201-d147-4663-bc85-bdd6deb110e8'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:07 devstack sudo[84086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:07 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:08 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.015s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:08 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Deleted volume successfully. Apr 14 03:49:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35077200-9b38-40cd-a4b6-54876297a3ac tempest-DeleteServersTestJSON-1204053657 None] Lock "cinder-24a89388-d2bb-418e-86eb-dce7d4a23da7-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Flow 'volume_create_manager' (61471645-f9d5-4b72-b169-1433226eeffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141b321b-393b-4af5-9e77-8074e070ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141b321b-393b-4af5-9e77-8074e070ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1095577872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83ead9aecd4d4d80bbae66d9d162326a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:18Z,use_quota=True,user_id='b18cb86d650a4718b1cabf781a8b1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599eeab7-34bc-4475-bc0a-930a3c2ce70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599eeab7-34bc-4475-bc0a-930a3c2ce70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d53ebe1-b1b6-48b5-9b7a-30cdc6342613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d53ebe1-b1b6-48b5-9b7a-30cdc6342613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9', 'volume_name': 'volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207f27ae-5518-4384-8b2d-c4a1c82221c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207f27ae-5518-4384-8b2d-c4a1c82221c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e8394e-31aa-4ac6-ac45-07f329df09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:17 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Volume 3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9', 'volume_size': 1} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1095577872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83ead9aecd4d4d80bbae66d9d162326a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:18Z,use_quota=True,user_id='b18cb86d650a4718b1cabf781a8b1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Creating volume 3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:17 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:17 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 1073741824 Apr 14 03:49:17 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:18 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 1073741824" returned: 0 in 0.841s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:18 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 Apr 14 03:49:18 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:19 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" returned: 0 in 0.618s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e8394e-31aa-4ac6-ac45-07f329df09d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f2dc65-a6c7-40f4-93b5-fedecf33e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:19 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Volume volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 (3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9): created successfully Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f2dc65-a6c7-40f4-93b5-fedecf33e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Flow 'volume_create_manager' (61471645-f9d5-4b72-b169-1433226eeffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-714e13a3-6385-468b-9acf-694b2dd87ff2 req-db64dc98-dd7d-4f4c-91bd-897d0ccd0993 tempest-VolumesGetTestJSON-1886234137 None] Created volume successfully. Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Acquiring lock "cinder-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "cinder-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Acquiring lock "cinder-quobyte-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "cinder-quobyte-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c385533-d5f4-4649-919b-68a91f0a3389]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:20 devstack sudo[84246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 Apr 14 03:49:20 devstack sudo[84246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:20 devstack sudo[84246]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" returned: 0 in 0.606s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:20 devstack sudo[84283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9 Apr 14 03:49:20 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8aad1168-954a-4b3a-8240-6faa3773254b tempest-BackendsCapabilitiesAdminTestsJSON-1432936361 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82370) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 14 03:49:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-65b1bc0f-8c7e-4924-9ac0-e6f7126d3fa9 tempest-BackendsCapabilitiesAdminTestsJSON-1432936361 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82370) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 14 03:49:22 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" returned: 0 in 1.181s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "cinder-quobyte-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9" released by "delete_volume" :: held 1.878s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG cinder.quota [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Created reservations ['92f1988a-2f0b-49e5-8804-148f95d4cfaf', '60b35512-78f9-448b-aacf-905b609f9866', '8898c371-062a-4018-9fde-89cea9a6d87e', '2574c97d-3068-4826-b1ed-6333b04f544c'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:22 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:22 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:23 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.216s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:23 devstack cinder-volume[82370]: DEBUG cinder.manager [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:23 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Deleted volume successfully. Apr 14 03:49:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-532dff14-4868-49ca-b9b2-393c0a312819 req-89ec6015-164f-44ab-a7f1-30bad57ffdc0 tempest-VolumesGetTestJSON-1886234137 None] Lock "cinder-3d0c4b8c-332c-4e82-ae9e-8ee3eae78ab9-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Flow 'volume_create_manager' (f4bab262-55d9-4c52-afd2-899a45f032a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dc921-80e8-4be3-bd61-f5d6a13902b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dc921-80e8-4be3-bd61-f5d6a13902b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1660720835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef912eb-9997-477d-a911-95c6323b84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3509f08bd05422a8449cef583ca9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:24Z,use_quota=True,user_id='01bf1846773e460087e0cd2db028c4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ccdf3f-e3b2-4b3a-847f-2dce2d25f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ccdf3f-e3b2-4b3a-847f-2dce2d25f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35011b34-57d0-439a-a8d7-68045612ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35011b34-57d0-439a-a8d7-68045612ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef912eb-9997-477d-a911-95c6323b84e6', 'volume_name': 'volume-9ef912eb-9997-477d-a911-95c6323b84e6', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b13245-e172-407d-8249-cc4e7d4978b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b13245-e172-407d-8249-cc4e7d4978b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa01acd7-39dd-4ae3-be81-784c7b564f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:24 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Volume 9ef912eb-9997-477d-a911-95c6323b84e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef912eb-9997-477d-a911-95c6323b84e6', 'volume_size': 1} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1660720835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef912eb-9997-477d-a911-95c6323b84e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3509f08bd05422a8449cef583ca9845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:24Z,use_quota=True,user_id='01bf1846773e460087e0cd2db028c4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Creating volume 9ef912eb-9997-477d-a911-95c6323b84e6 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:24 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:24 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 1073741824 Apr 14 03:49:24 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:25 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 1073741824" returned: 0 in 1.364s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:25 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=5 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:49:25 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=43,cinder:SELECT=35,cinder:INSERT=11,cinder:DELETE=4 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:49:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:26 devstack sudo[84357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 Apr 14 03:49:26 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:26 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6" returned: 0 in 0.968s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa01acd7-39dd-4ae3-be81-784c7b564f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef912eb-9997-477d-a911-95c6323b84e6', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8432c0fd-7726-44a5-ae6b-042921c36fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Volume volume-9ef912eb-9997-477d-a911-95c6323b84e6 (9ef912eb-9997-477d-a911-95c6323b84e6): created successfully Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8432c0fd-7726-44a5-ae6b-042921c36fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Flow 'volume_create_manager' (f4bab262-55d9-4c52-afd2-899a45f032a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-20eccfed-8c8a-409f-9773-6a0eecf6ac8b tempest-ServerRescueNegativeTestJSON-874981842 None] Created volume successfully. Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b80fc724-9e77-4b73-96c0-640a8896d019 tempest-GroupsTest-908408503 None] Group tempest-Group1-1707670309: creating Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b80fc724-9e77-4b73-96c0-640a8896d019 tempest-GroupsTest-908408503 None] Group tempest-Group1-1707670309: created successfully Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b80fc724-9e77-4b73-96c0-640a8896d019 tempest-GroupsTest-908408503 None] Create group completed successfully. Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-513ac1c2-bc41-4646-9ba6-6927c585cf66 tempest-GroupSnapshotsV319Test-1590139578 None] Group tempest-GroupSnapshotsV319Test-Group-2121148990: creating Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-513ac1c2-bc41-4646-9ba6-6927c585cf66 tempest-GroupSnapshotsV319Test-1590139578 None] Group tempest-GroupSnapshotsV319Test-Group-2121148990: created successfully Apr 14 03:49:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-513ac1c2-bc41-4646-9ba6-6927c585cf66 tempest-GroupSnapshotsV319Test-1590139578 None] Create group completed successfully. Apr 14 03:49:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecbbb892-9463-4747-be71-3cf226aa4e88 tempest-GroupsTest-908408503 None] Group tempest-Group2-1679587101: creating Apr 14 03:49:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecbbb892-9463-4747-be71-3cf226aa4e88 tempest-GroupsTest-908408503 None] Group tempest-Group2-1679587101: created successfully Apr 14 03:49:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecbbb892-9463-4747-be71-3cf226aa4e88 tempest-GroupsTest-908408503 None] Create group completed successfully. Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Flow 'volume_create_manager' (e056cd2a-bfb0-4fa1-b509-4d5ca8c20df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488b87b3-50a4-421e-930f-0e0539b8d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488b87b3-50a4-421e-930f-0e0539b8d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560543831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe105001-0aaa-4ea8-9530-7f3fffb92044,host='devstack@QuobyteHD#QuobyteHD',id=8a38b139-2f52-4d67-8571-d17151c22782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83df8e9763d84d03963a2ffc296a362e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:30Z,use_quota=True,user_id='a4000e21d68b4c60b403b0f8dcb0a341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac6b1221-9b03-4c8c-ba30-7cd9ff028335),volume_type_id=ac6b1221-9b03-4c8c-ba30-7cd9ff028335)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc532434-1280-4aee-837c-361be1c17542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc532434-1280-4aee-837c-361be1c17542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f9fa71-b776-4e76-bf8f-0a8fe618181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f9fa71-b776-4e76-bf8f-0a8fe618181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a38b139-2f52-4d67-8571-d17151c22782', 'volume_name': 'volume-8a38b139-2f52-4d67-8571-d17151c22782', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864cbdbc-074f-42e2-949e-2a696f26d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864cbdbc-074f-42e2-949e-2a696f26d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f2dbb8-3f26-422a-a449-e67d9b815776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:29 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Volume 8a38b139-2f52-4d67-8571-d17151c22782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a38b139-2f52-4d67-8571-d17151c22782', 'volume_size': 1} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe105001-0aaa-4ea8-9530-7f3fffb92044,created_at=2026-04-14T01:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560543831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe105001-0aaa-4ea8-9530-7f3fffb92044,host='devstack@QuobyteHD#QuobyteHD',id=8a38b139-2f52-4d67-8571-d17151c22782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83df8e9763d84d03963a2ffc296a362e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:30Z,use_quota=True,user_id='a4000e21d68b4c60b403b0f8dcb0a341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac6b1221-9b03-4c8c-ba30-7cd9ff028335),volume_type_id=ac6b1221-9b03-4c8c-ba30-7cd9ff028335)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Creating volume 8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:29 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:29 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 1073741824 Apr 14 03:49:29 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:30 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 1073741824" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:30 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 Apr 14 03:49:30 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:31 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782" returned: 0 in 0.656s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f2dbb8-3f26-422a-a449-e67d9b815776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a38b139-2f52-4d67-8571-d17151c22782', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01e4aad-4698-4cfb-b168-43111bd3ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Volume volume-8a38b139-2f52-4d67-8571-d17151c22782 (8a38b139-2f52-4d67-8571-d17151c22782): created successfully Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01e4aad-4698-4cfb-b168-43111bd3ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Flow 'volume_create_manager' (e056cd2a-bfb0-4fa1-b509-4d5ca8c20df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:31 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c6992ddd-cb83-461e-8374-421ddaa027c1 tempest-GroupSnapshotsV319Test-1590139578 None] Created volume successfully. Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (3def8d24-3b94-4ca5-9743-ff1a6cc92d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f965edf0-448c-44e3-8b1e-6da21089fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f965edf0-448c-44e3-8b1e-6da21089fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436613854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5aff7f8-aeda-4769-b84b-e79a07ce8f24,host='devstack@QuobyteHD#QuobyteHD',id=90987b5c-62f1-4891-9b99-a386c70c6905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:31Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331652df-36ec-49b1-9135-db0e04cd52f2),volume_type_id=331652df-36ec-49b1-9135-db0e04cd52f2)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36671d2-8f85-4a7f-a5fb-528b4c5e2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36671d2-8f85-4a7f-a5fb-528b4c5e2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad28f3f-61f1-40da-a3b6-71b991160807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad28f3f-61f1-40da-a3b6-71b991160807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90987b5c-62f1-4891-9b99-a386c70c6905', 'volume_name': 'volume-90987b5c-62f1-4891-9b99-a386c70c6905', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25fa2b-898f-45a4-b9d2-1d7c7cda6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25fa2b-898f-45a4-b9d2-1d7c7cda6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213913b-25fb-4b22-9afe-4deace1573ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:31 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Volume 90987b5c-62f1-4891-9b99-a386c70c6905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90987b5c-62f1-4891-9b99-a386c70c6905', 'volume_size': 1} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5aff7f8-aeda-4769-b84b-e79a07ce8f24,created_at=2026-04-14T01:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436613854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5aff7f8-aeda-4769-b84b-e79a07ce8f24,host='devstack@QuobyteHD#QuobyteHD',id=90987b5c-62f1-4891-9b99-a386c70c6905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:31Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331652df-36ec-49b1-9135-db0e04cd52f2),volume_type_id=331652df-36ec-49b1-9135-db0e04cd52f2)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Creating volume 90987b5c-62f1-4891-9b99-a386c70c6905 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:31 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:31 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 1073741824 Apr 14 03:49:31 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:32 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 1073741824" returned: 0 in 0.856s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] GroupSnapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: creating. Apr 14 03:49:32 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 Apr 14 03:49:32 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Group snapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: creating. {{(pid=82370) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:32 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.437s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213913b-25fb-4b22-9afe-4deace1573ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90987b5c-62f1-4891-9b99-a386c70c6905', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdfc3ec-d0e2-4893-953d-d55dc88bac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Creating offline snapshot 8e62050f-7a06-46f0-a5c3-aa92e7140141 of volume 8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:49:32 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Volume volume-90987b5c-62f1-4891-9b99-a386c70c6905 (90987b5c-62f1-4891-9b99-a386c70c6905): created successfully Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdfc3ec-d0e2-4893-953d-d55dc88bac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (3def8d24-3b94-4ca5-9743-ff1a6cc92d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[32464b15-3950-40c7-a235-48a2f1b876e0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e19438f7-312c-40a4-948e-2524e8eb1b3f tempest-GroupsTest-908408503 None] Created volume successfully. Apr 14 03:49:33 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 Apr 14 03:49:33 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:33 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:33 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 1G Apr 14 03:49:33 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Acquiring lock "cinder-quobyte-90987b5c-62f1-4891-9b99-a386c70c6905" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-90987b5c-62f1-4891-9b99-a386c70c6905" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b3928-0eb8-4ced-bcbd-a7f97d3594e0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:33 devstack sudo[84449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 Apr 14 03:49:33 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:34 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 1G" returned: 0 in 0.623s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a38b139-2f52-4d67-8571-d17151c22782 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:34 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a38b139-2f52-4d67-8571-d17151c22782 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 Apr 14 03:49:34 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:34 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905" returned: 0 in 0.619s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:34 devstack sudo[84460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905 Apr 14 03:49:34 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:34 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a38b139-2f52-4d67-8571-d17151c22782 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:34 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:34 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 Apr 14 03:49:34 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:34 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90987b5c-62f1-4891-9b99-a386c70c6905" returned: 0 in 0.426s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-90987b5c-62f1-4891-9b99-a386c70c6905" released by "delete_volume" :: held 1.065s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Created reservations ['145b49b6-5b2c-49f6-ba93-aafa5a754642'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:34 devstack cinder-volume[82370]: WARNING cinder.quota [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2057775330 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2057775330, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:34 devstack cinder-volume[82370]: WARNING cinder.quota [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2057775330 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2057775330, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Created reservations ['5fb648d2-b5d7-4336-ba59-eb73826d7657', 'c5b5ce07-db3d-4ae0-b6f1-d57bace58058', '4212408f-aa79-4e85-8b1c-a369db2108f4', 'fda52170-dbd7-48b4-af6b-27434b5ef39b'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:34 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:34 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:35 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141" returned: 0 in 0.551s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:35 devstack sudo[84472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info Apr 14 03:49:35 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:35 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.543s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-766b99d2-925f-4c99-a257-6e0f6f0aa934 tempest-GroupsTest-908408503 None] Delete group completed successfully. Apr 14 03:49:35 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:35 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:35 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info Apr 14 03:49:35 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Created reservations ['87281769-62fa-4719-96cc-598a1945c0aa'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:35 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.info" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:36 devstack sudo[84486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:36 devstack sudo[84486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-63f4e2dd-6e18-4962-85b3-4bdff2456048 tempest-GroupSnapshotsV319Test-1590139578 None] group_snapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: created successfully Apr 14 03:49:36 devstack sudo[84486]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.575s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:36 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-91391c07-d722-443d-8164-6ec0b5748fe2 tempest-GroupsTest-908408503 None] Delete group completed successfully. Apr 14 03:49:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] group_snapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: deleting Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] group_snapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: deleting {{(pid=82370) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "cinder-quobyte-8e62050f-7a06-46f0-a5c3-aa92e7140141" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8e62050f-7a06-46f0-a5c3-aa92e7140141" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Deleting offline snapshot 8e62050f-7a06-46f0-a5c3-aa92e7140141 of volume 8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] snapshot_file for this snap is: volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b730926c-d05d-4e9b-b70c-8d15941e6abb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:38 devstack sudo[84553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 Apr 14 03:49:38 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f4484e2e-b21f-4508-afb6-afc5a505c00d tempest-GroupsTest-908408503 None] Group tempest-GroupsTest-Group-1719098024: creating Apr 14 03:49:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f4484e2e-b21f-4508-afb6-afc5a505c00d tempest-GroupsTest-908408503 None] Group tempest-GroupsTest-Group-1719098024: created successfully Apr 14 03:49:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f4484e2e-b21f-4508-afb6-afc5a505c00d tempest-GroupsTest-908408503 None] Create group completed successfully. Apr 14 03:49:38 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141" returned: 0 in 0.783s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a38b139-2f52-4d67-8571-d17151c22782(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:49:38 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ee9f61-b80b-4a03-aa86-33633acce5cd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:38 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 Apr 14 03:49:38 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:39 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782" returned: 0 in 0.956s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:39 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 Apr 14 03:49:39 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (b309487f-6b39-44ca-80be-b7a78bcdd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3d5d94-00a8-4186-8038-c64cf1bd4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3d5d94-00a8-4186-8038-c64cf1bd4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1634278198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=638f5b68-c053-410a-9b5c-735774282bfe,host='devstack@QuobyteHD#QuobyteHD',id=e4aa38d4-57ab-4daa-83dc-a555887772eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:40Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5a7799d-2e99-4fce-bcb6-07d40de4edbb),volume_type_id=f5a7799d-2e99-4fce-bcb6-07d40de4edbb)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730a588f-658f-49c0-9c5e-9eea6eb7181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730a588f-658f-49c0-9c5e-9eea6eb7181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422e1a3d-70a5-4878-8243-17146e469c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422e1a3d-70a5-4878-8243-17146e469c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4aa38d4-57ab-4daa-83dc-a555887772eb', 'volume_name': 'volume-e4aa38d4-57ab-4daa-83dc-a555887772eb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81a8913-1483-4747-a148-9ab80049ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81a8913-1483-4747-a148-9ab80049ed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1f9802-faf6-4b39-bd0b-fca365f7f900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:40 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Volume e4aa38d4-57ab-4daa-83dc-a555887772eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4aa38d4-57ab-4daa-83dc-a555887772eb', 'volume_size': 1} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=638f5b68-c053-410a-9b5c-735774282bfe,created_at=2026-04-14T01:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1634278198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=638f5b68-c053-410a-9b5c-735774282bfe,host='devstack@QuobyteHD#QuobyteHD',id=e4aa38d4-57ab-4daa-83dc-a555887772eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:40Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5a7799d-2e99-4fce-bcb6-07d40de4edbb),volume_type_id=f5a7799d-2e99-4fce-bcb6-07d40de4edbb)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Creating volume e4aa38d4-57ab-4daa-83dc-a555887772eb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:40 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:40 devstack sudo[84589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb 1073741824 Apr 14 03:49:40 devstack sudo[84589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:40 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141" returned: 0 in 1.298s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:40 devstack sudo[84611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141 Apr 14 03:49:40 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:41 devstack sudo[84589]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb 1073741824" returned: 0 in 1.294s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:41 devstack sudo[84616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb Apr 14 03:49:41 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:41 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782.8e62050f-7a06-46f0-a5c3-aa92e7140141" returned: 0 in 1.029s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8e62050f-7a06-46f0-a5c3-aa92e7140141" released by "_delete_snapshot" :: held 4.246s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" released by "delete_snapshot" :: held 4.271s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:42 devstack cinder-volume[82370]: WARNING cinder.quota [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1471300936 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1471300936, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:42 devstack cinder-volume[82370]: WARNING cinder.quota [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1471300936 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1471300936, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] Created reservations ['8f362968-a17b-4f28-b321-fb7d0edaa027', 'a105cd46-88d9-48b4-8ad5-15f03cfe21a5', '52daadf8-b5d1-44c3-b258-fcd9aa88501d', '6133e6d1-36c5-48ec-a0ee-2b3312c7e1af'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:42 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-074c6eb6-d3bb-4d5b-bdfc-1e5ccf56dcc0 tempest-GroupSnapshotsV319Test-1590139578 None] group_snapshot 773d316d-6eb2-415d-b34f-58931bddb7b3: deleted successfully Apr 14 03:49:42 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb" returned: 0 in 1.032s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1f9802-faf6-4b39-bd0b-fca365f7f900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4aa38d4-57ab-4daa-83dc-a555887772eb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba83701-4879-4c32-b42b-cbaa290f1afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:42 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Volume volume-e4aa38d4-57ab-4daa-83dc-a555887772eb (e4aa38d4-57ab-4daa-83dc-a555887772eb): created successfully Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba83701-4879-4c32-b42b-cbaa290f1afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (b309487f-6b39-44ca-80be-b7a78bcdd041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:42 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6134c6a1-1a63-4d5a-a55c-ea26c49f700a tempest-GroupsTest-908408503 None] Created volume successfully. Apr 14 03:49:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" acquired by "delete_volume" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:43 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e594af-95d1-4e3a-a778-cbae93915adf]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:44 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 Apr 14 03:49:44 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (df2656cf-38cd-402f-a0c2-9332f65f3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a9e6ae-d105-4e5c-9dae-d4ac51817121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a9e6ae-d105-4e5c-9dae-d4ac51817121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890425400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=638f5b68-c053-410a-9b5c-735774282bfe,host='devstack@QuobyteHD#QuobyteHD',id=f1f0a800-8c68-497e-a5f8-c96585e4119b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:45Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5a7799d-2e99-4fce-bcb6-07d40de4edbb),volume_type_id=f5a7799d-2e99-4fce-bcb6-07d40de4edbb)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf435647-68a3-4b7a-a620-1b28f4638226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf435647-68a3-4b7a-a620-1b28f4638226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d61895-9cf3-4ee3-a80f-2adcb0b87f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d61895-9cf3-4ee3-a80f-2adcb0b87f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f0a800-8c68-497e-a5f8-c96585e4119b', 'volume_name': 'volume-f1f0a800-8c68-497e-a5f8-c96585e4119b', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba86379-9931-4f19-a14c-9926ad09116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba86379-9931-4f19-a14c-9926ad09116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a585bfd-3bd6-4021-abf0-8a5b7a85cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Volume f1f0a800-8c68-497e-a5f8-c96585e4119b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f0a800-8c68-497e-a5f8-c96585e4119b', 'volume_size': 1} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=638f5b68-c053-410a-9b5c-735774282bfe,created_at=2026-04-14T01:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890425400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=638f5b68-c053-410a-9b5c-735774282bfe,host='devstack@QuobyteHD#QuobyteHD',id=f1f0a800-8c68-497e-a5f8-c96585e4119b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34e2b5c2f694ab9a214e863e21017c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:45Z,use_quota=True,user_id='d733ef622ee8425ba2c01dfee6ef5080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5a7799d-2e99-4fce-bcb6-07d40de4edbb),volume_type_id=f5a7799d-2e99-4fce-bcb6-07d40de4edbb)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Creating volume f1f0a800-8c68-497e-a5f8-c96585e4119b {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:44 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Acquiring lock "cinder-9ef912eb-9997-477d-a911-95c6323b84e6-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:45 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b 1073741824 Apr 14 03:49:45 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "cinder-9ef912eb-9997-477d-a911-95c6323b84e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Acquiring lock "cinder-quobyte-9ef912eb-9997-477d-a911-95c6323b84e6" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "cinder-quobyte-9ef912eb-9997-477d-a911-95c6323b84e6" acquired by "delete_volume" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af3c72-6bfd-4230-8b8c-d03bab74592a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:45 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 Apr 14 03:49:45 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:45 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782" returned: 0 in 1.676s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:45 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782 Apr 14 03:49:45 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:46 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6" returned: 0 in 0.960s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:46 devstack sudo[84701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6 Apr 14 03:49:46 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:46 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a38b139-2f52-4d67-8571-d17151c22782" returned: 0 in 0.798s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "cinder-quobyte-8a38b139-2f52-4d67-8571-d17151c22782" released by "delete_volume" :: held 2.586s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Created reservations ['8a0fab55-f4ae-4727-8e0e-7309ae3585d2'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:46 devstack cinder-volume[82370]: WARNING cinder.quota [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1471300936 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1471300936, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Created reservations ['38fa1fa0-9c15-40d6-b71a-7b5be1c664b5', '2ac4052c-befb-4050-8fb0-b4f1e027f1cb', '48bd183a-19c5-4e10-8b8a-009baf09aae7', 'ab872c49-aa05-463b-a253-a36c63586523'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:46 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b 1073741824" returned: 0 in 1.557s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:46 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b Apr 14 03:49:46 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:46 devstack sudo[84709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:46 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:46 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9ef912eb-9997-477d-a911-95c6323b84e6" returned: 0 in 0.813s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "cinder-quobyte-9ef912eb-9997-477d-a911-95c6323b84e6" released by "delete_volume" :: held 1.893s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Created reservations ['da7f1db2-df1c-42fa-9534-cefbd16b7343', '487ddd33-6598-4d6e-bd8e-7ad5617f9f0a', '8f702963-dbaf-4488-a1ee-d0ccb1e77ad1', '42866e86-af0f-4a07-9fc6-08ed1bed53f6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:47 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:47 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:47 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b" returned: 0 in 1.330s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] <== create_volume: return (2941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.943s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a585bfd-3bd6-4021-abf0-8a5b7a85cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f0a800-8c68-497e-a5f8-c96585e4119b', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e553c105-0a3a-4a80-b0c1-a81b4ad8591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:47 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Volume volume-f1f0a800-8c68-497e-a5f8-c96585e4119b (f1f0a800-8c68-497e-a5f8-c96585e4119b): created successfully Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e553c105-0a3a-4a80-b0c1-a81b4ad8591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Flow 'volume_create_manager' (df2656cf-38cd-402f-a0c2-9332f65f3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-40d0cc1c-0b0f-4022-bdb4-bea76974aae9 tempest-GroupsTest-908408503 None] Created volume successfully. Apr 14 03:49:48 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.397s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:48 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6e568957-8353-43c3-89cc-e59d019159d0 tempest-GroupSnapshotsV319Test-1590139578 None] Delete group completed successfully. Apr 14 03:49:48 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.285s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:48 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Deleted volume successfully. Apr 14 03:49:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5007d0a-fb90-4852-8c9e-47bc98d1aa13 tempest-ServerRescueNegativeTestJSON-874981842 None] Lock "cinder-9ef912eb-9997-477d-a911-95c6323b84e6-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e9b52cc9-c2d7-4d4b-ab59-22e3a1a2f0c8 tempest-GroupsTest-908408503 None] Update group completed successfully. Apr 14 03:49:51 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-62c3a152-a434-44ec-9ca1-91bef8ea178e tempest-GroupsTest-908408503 None] Update group completed successfully. Apr 14 03:49:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Acquiring lock "cinder-quobyte-e4aa38d4-57ab-4daa-83dc-a555887772eb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-e4aa38d4-57ab-4daa-83dc-a555887772eb" acquired by "delete_volume" :: waited 0.029s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[970af4c6-1e2a-4084-ae8c-f92f720a0b92]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:53 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb Apr 14 03:49:53 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:54 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb" returned: 0 in 0.807s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:54 devstack sudo[84832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb Apr 14 03:49:54 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:54 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e4aa38d4-57ab-4daa-83dc-a555887772eb" returned: 0 in 0.917s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-e4aa38d4-57ab-4daa-83dc-a555887772eb" released by "delete_volume" :: held 1.835s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Acquiring lock "cinder-quobyte-f1f0a800-8c68-497e-a5f8-c96585e4119b" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-f1f0a800-8c68-497e-a5f8-c96585e4119b" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e79ca-7a6a-42a8-b28a-b099d18265d5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:55 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b Apr 14 03:49:55 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:55 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b" returned: 0 in 0.857s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:55 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b Apr 14 03:49:55 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:56 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f1f0a800-8c68-497e-a5f8-c96585e4119b" returned: 0 in 0.569s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "cinder-quobyte-f1f0a800-8c68-497e-a5f8-c96585e4119b" released by "delete_volume" :: held 1.455s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Created reservations ['7231641d-a936-4200-95e6-356521f0ba19'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:56 devstack cinder-volume[82370]: WARNING cinder.quota [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1168662828 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1168662828, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:56 devstack cinder-volume[82370]: WARNING cinder.quota [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1168662828 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1168662828, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Created reservations ['3ea6b2ab-4579-449f-89d8-54e23b711de3', '2af64da4-b7e5-4e2a-8dd1-09cfa05fd0c8', '992937a3-ad39-4f27-bd8a-247ab5d04238', 'd8ca8df1-bccd-4118-b003-4dab2998823a'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Created reservations ['34aed07c-3b1c-4ffc-b904-5648bd24a944', '42095e1f-4e44-4f3b-9c21-d9bc7e5345c4', 'ace1da98-d8de-4864-a493-3afc0630c166', '6eec2164-8146-4118-987c-528503c98b71'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:56 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:56 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:57 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.538s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:57 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-19bce132-b95d-4d6d-a203-cf2926ba1de5 tempest-GroupsTest-908408503 None] Delete group completed successfully. Apr 14 03:49:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a1c30561-5784-4dc4-b10e-aa74e1afbecd tempest-GroupsV314Test-1027090532 None] Group tempest-GroupsV314Test-Group-192159531: creating Apr 14 03:49:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a1c30561-5784-4dc4-b10e-aa74e1afbecd tempest-GroupsV314Test-1027090532 None] Group tempest-GroupsV314Test-Group-192159531: created successfully Apr 14 03:49:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a1c30561-5784-4dc4-b10e-aa74e1afbecd tempest-GroupsV314Test-1027090532 None] Create group completed successfully. Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:58 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:49:58 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:58 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Flow 'volume_create_manager' (1dacb667-3fab-4174-8ef4-987847413f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e2d16-2599-485e-8dd5-f139b8557045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e2d16-2599-485e-8dd5-f139b8557045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-831973236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bbbd068-c37a-47b8-8c62-5ef3e8f45b30,host='devstack@QuobyteHD#QuobyteHD',id=13ecc486-5304-4757-8ea4-2a450380c90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35359f083654085a584a3addfda9145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:59Z,use_quota=True,user_id='ad3202a1a03148449c3398402a10b386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(402089ee-a769-4956-b4f3-ddb0f40ec53d),volume_type_id=402089ee-a769-4956-b4f3-ddb0f40ec53d)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14736d-5e24-4654-81b3-64d7fc01970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14736d-5e24-4654-81b3-64d7fc01970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eacfc3d-2208-4d66-90a5-78cfff2d01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eacfc3d-2208-4d66-90a5-78cfff2d01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ecc486-5304-4757-8ea4-2a450380c90a', 'volume_name': 'volume-13ecc486-5304-4757-8ea4-2a450380c90a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c013dee-2848-48dc-ad4e-a5650a253d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c013dee-2848-48dc-ad4e-a5650a253d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9094782e-0c38-4948-97a5-994ae9df3468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:49:59 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Volume 13ecc486-5304-4757-8ea4-2a450380c90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ecc486-5304-4757-8ea4-2a450380c90a', 'volume_size': 1} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6bbbd068-c37a-47b8-8c62-5ef3e8f45b30,created_at=2026-04-14T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-831973236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bbbd068-c37a-47b8-8c62-5ef3e8f45b30,host='devstack@QuobyteHD#QuobyteHD',id=13ecc486-5304-4757-8ea4-2a450380c90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35359f083654085a584a3addfda9145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:49:59Z,use_quota=True,user_id='ad3202a1a03148449c3398402a10b386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(402089ee-a769-4956-b4f3-ddb0f40ec53d),volume_type_id=402089ee-a769-4956-b4f3-ddb0f40ec53d)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Creating volume 13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:49:59 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:49:59 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a 1073741824 Apr 14 03:49:59 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:49:59 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.953s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:49:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:49:59 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a 1073741824" returned: 0 in 0.944s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Flow 'volume_create_manager' (899a75eb-64db-4526-b835-534dfefd4314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d80059-1b98-4c5b-ae98-5b8144fa62f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d80059-1b98-4c5b-ae98-5b8144fa62f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b6d654-8c5a-4d73-8746-802c0e4c2b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ee6b904c304a3fae9d9227f70a1093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:00Z,use_quota=True,user_id='f272758b3bce458596b9dee96c604ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb8d7c8-1443-411b-9acd-443b5d5b4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb8d7c8-1443-411b-9acd-443b5d5b4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f2469-95c6-4179-a113-cb1c55029ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.image.glance [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Creating Keystone auth plugin from conf {{(pid=82370) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:50:00 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:00 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f2469-95c6-4179-a113-cb1c55029ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42b6d654-8c5a-4d73-8746-802c0e4c2b28', 'volume_name': 'volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90a592-13e0-4ea9-ad04-d925eee9a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90a592-13e0-4ea9-ad04-d925eee9a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a9d082-0388-48e9-a86e-e965406cc10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Trying to clone 42b6d654-8c5a-4d73-8746-802c0e4c2b28 from image 561c6fea-555e-40c4-aed9-ba813c6be050 at location (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]). {{(pid=82370) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:50:00 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.750s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9094782e-0c38-4948-97a5-994ae9df3468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ecc486-5304-4757-8ea4-2a450380c90a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08dcf1b-95a1-4d3f-b074-e76adff0bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Volume volume-13ecc486-5304-4757-8ea4-2a450380c90a (13ecc486-5304-4757-8ea4-2a450380c90a): created successfully Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08dcf1b-95a1-4d3f-b074-e76adff0bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Flow 'volume_create_manager' (1dacb667-3fab-4174-8ef4-987847413f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-086e936e-e52a-4b70-8508-2e3f05d85ed6 tempest-GroupsV314Test-1027090532 None] Created volume successfully. Apr 14 03:50:01 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:50:01 devstack cinder-volume[82370]: INFO cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:50:01 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be34a25-58cd-4be1-bed6-e90994e8cca6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:01 devstack sudo[84908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD Apr 14 03:50:01 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:02 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 is fetched for user f272758b3bce458596b9dee96c604ec2. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d167447-2057-4c37-9be7-2f3eeb40929f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:02 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Cloning volume 13ecc486-5304-4757-8ea4-2a450380c90a to volume 9b0627ed-fe76-4c01-98cf-3635fe52fb0e Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Creating offline snapshot 4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 of volume 13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:02 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD Apr 14 03:50:02 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb19b8-eaaf-4059-8c1e-673d3a215c64]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:02 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:02 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ae8c21b0-4aaa-4abb-b34f-6b6d0c587b45 tempest-GroupsV320Test-2104256609 None] Group tempest-GroupsV320Test-Group-359540738: creating Apr 14 03:50:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ae8c21b0-4aaa-4abb-b34f-6b6d0c587b45 tempest-GroupsV320Test-2104256609 None] Group tempest-GroupsV320Test-Group-359540738: created successfully Apr 14 03:50:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ae8c21b0-4aaa-4abb-b34f-6b6d0c587b45 tempest-GroupsV320Test-2104256609 None] Create group completed successfully. Apr 14 03:50:03 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:03 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.809s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:03 devstack sudo[84929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 1G Apr 14 03:50:03 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:03 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 1G" returned: 0 in 0.655s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ecc486-5304-4757-8ea4-2a450380c90a -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:03 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ecc486-5304-4757-8ea4-2a450380c90a -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:03 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:04 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ecc486-5304-4757-8ea4-2a450380c90a -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.543s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:04 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:04 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:04 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Created reservations ['8eea3bc7-ef61-4a4a-beb7-97917b0b2eb3'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:04 devstack sudo[84945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:04 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:04 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:04 devstack sudo[84948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info Apr 14 03:50:04 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:05 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:05 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-72865dbd-a32a-44c8-80b0-948578db37a5 tempest-GroupsV320Test-2104256609 None] Delete group completed successfully. Apr 14 03:50:05 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:05 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:50:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:05 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info Apr 14 03:50:05 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:06 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.info" returned: 0 in 0.622s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Acquiring lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] snapshot: 4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5, volume: 9b0627ed-fe76-4c01-98cf-3635fe52fb0e, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff95a0eb-f92f-4f23-bd33-86773c6f640d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:06 devstack sudo[84956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:06 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:06 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.622s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ecc486-5304-4757-8ea4-2a450380c90a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[409dfd45-94b5-428a-b635-a7ebf9711846]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:06 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:06 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:07 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.733s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:07 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:50:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:07 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e Apr 14 03:50:07 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:11 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" returned: 0 in 3.582s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f188a-7977-445b-8f69-3dccc64f36e3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:11 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:11 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Flow 'volume_create_manager' (c7b5cee5-5e81-44fe-ad00-095f9041b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd1b887-9b98-4a0c-87d6-8efda8fffcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd1b887-9b98-4a0c-87d6-8efda8fffcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-653694675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f002b2-fbd4-43fe-8ff8-27d5242a3dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe41a8b3137149e5b7ce4b305e65dfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:12Z,use_quota=True,user_id='e24fd904601b4d1a90c99e2c3d402b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b5bc31-800a-4132-85b3-b5ede424b422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b5bc31-800a-4132-85b3-b5ede424b422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ef9efa-bcc5-4793-8758-96839d297d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ef9efa-bcc5-4793-8758-96839d297d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f002b2-fbd4-43fe-8ff8-27d5242a3dd7', 'volume_name': 'volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb5895b-b17a-496b-bfa0-bdce45e5f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb5895b-b17a-496b-bfa0-bdce45e5f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a3b3aa-b09a-4d35-bbbf-432ccad91c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Volume 79f002b2-fbd4-43fe-8ff8-27d5242a3dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7', 'volume_size': 1} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:11 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.771s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a, size 1024.00 MB, duration 3.58 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:50:11 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Converted 1024.00 MB image at 285.74 MB/s Apr 14 03:50:11 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:50:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:11 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e Apr 14 03:50:11 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:12 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" returned: 0 in 0.698s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" released by "_copy_volume_from_snapshot" :: held 6.474s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Acquiring lock "cinder-quobyte-4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Deleting offline snapshot 4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 of volume 13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] snapshot_file for this snap is: volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b09aa-4983-4b76-b0e3-f324a3577c87]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:12 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:12 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:13 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.752s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ecc486-5304-4757-8ea4-2a450380c90a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e49d970-5eb2-48de-9784-e6dcac79e96b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:13 devstack sudo[85006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:13 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:14 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.628s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:14 devstack sudo[85011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:14 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:14 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.527s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:14 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5 Apr 14 03:50:14 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:15 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a.4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" returned: 0 in 0.576s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-4baf90f6-fbf2-47b9-b99a-4ff47dcb52f5" released by "_delete_snapshot" :: held 2.570s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.837s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b6d654-8c5a-4d73-8746-802c0e4c2b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ee6b904c304a3fae9d9227f70a1093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:00Z,use_quota=True,user_id='f272758b3bce458596b9dee96c604ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Creating volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:15 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:15 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1073741824 Apr 14 03:50:15 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-662a1ccf-66ff-4a44-bfb0-eddbd3d78078 tempest-GroupsV314Test-1027090532 None] Create group from source-group-6bbbd068-c37a-47b8-8c62-5ef3e8f45b30 completed successfully. Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Acquiring lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de26e9-e85e-4afb-b035-3921e1a1e0b6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:15 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e Apr 14 03:50:15 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:15 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1073741824" returned: 0 in 0.649s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:15 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:15 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:16 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" returned: 0 in 0.599s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:16 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e Apr 14 03:50:16 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:16 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.643s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-653694675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f002b2-fbd4-43fe-8ff8-27d5242a3dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe41a8b3137149e5b7ce4b305e65dfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:12Z,use_quota=True,user_id='e24fd904601b4d1a90c99e2c3d402b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Creating volume 79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:16 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Attempting download of 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:50:16 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 1073741824 Apr 14 03:50:16 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd5d7a0-8baa-4cb4-850d-071a8b2b9a37]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_ {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:16 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_ Apr 14 03:50:16 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:16 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-9b0627ed-fe76-4c01-98cf-3635fe52fb0e" released by "delete_volume" :: held 1.093s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Created reservations ['e50e80da-7641-4c3b-9ade-7101395f96f6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:16 devstack cinder-volume[82370]: WARNING cinder.quota [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2107675611 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2107675611, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:50:16 devstack cinder-volume[82370]: WARNING cinder.quota [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2107675611 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2107675611, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Created reservations ['2f07d6f5-68b9-4353-ab63-f85045a1e1b3', '5d9ec3fe-c822-437c-8f35-0a4f5d41e73f', '261544f7-0418-4df6-9263-9987927000ea', 'aeba6375-817e-47a5-a91d-bdc1d7e0a599'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:16 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:16 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:17 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 1073741824" returned: 0 in 0.616s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:17 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_" returned: 0 in 0.590s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_ {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:17 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 Apr 14 03:50:17 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:17 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_ Apr 14 03:50:17 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:17 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:17 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5f3b0728-3141-4041-8e25-58707de547ed tempest-GroupsV314Test-1027090532 None] Delete group completed successfully. Apr 14 03:50:17 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a3b3aa-b09a-4d35-bbbf-432ccad91c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0139d5b-c91a-4df9-a505-2206164ed4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:17 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Volume volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 (79f002b2-fbd4-43fe-8ff8-27d5242a3dd7): created successfully Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0139d5b-c91a-4df9-a505-2206164ed4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Flow 'volume_create_manager' (c7b5cee5-5e81-44fe-ad00-095f9041b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:17 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-94e166bd-a234-434e-b63c-a85aa4fe9c18 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Created volume successfully. Apr 14 03:50:17 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_" returned: 1 in 0.518s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_a05evza_' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fca5c8-1248-41b1-abcc-fcc3975cee03]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:17 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD Apr 14 03:50:17 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Acquiring lock "cinder-quobyte-13ecc486-5304-4757-8ea4-2a450380c90a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-13ecc486-5304-4757-8ea4-2a450380c90a" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc75856-ea7a-4690-a4e8-29245fa772df]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:18 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] 561c6fea-555e-40c4-aed9-ba813c6be050 was qcow2, converting to raw {{(pid=82370) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:18 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:18 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:18 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:18 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:18 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.590s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:18 devstack sudo[85078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a Apr 14 03:50:18 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Acquiring lock "cinder-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "cinder-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Acquiring lock "cinder-quobyte-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "cinder-quobyte-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7614619c-ad0a-45cd-9c10-74f1b252c61b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:18 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 Apr 14 03:50:18 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:19 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 1.012s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_iso601mmdevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:50:19 devstack cinder-volume[82370]: INFO cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Converted 112.00 MB image at 110.54 MB/s Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:19 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1G Apr 14 03:50:19 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:19 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-13ecc486-5304-4757-8ea4-2a450380c90a" returned: 0 in 0.572s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Lock "cinder-quobyte-13ecc486-5304-4757-8ea4-2a450380c90a" released by "delete_volume" :: held 1.206s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Created reservations ['a3f74ea8-deec-402d-b842-8018ac734b8f'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Created reservations ['ac45e2ae-16d9-4b34-ad4d-96d9415c99ef', '42f90271-0a87-407c-9a67-31859b42035f', 'a99a55cb-b6b0-43c2-be2f-392abbb0cb05', 'de265743-df05-4a53-aaaf-f72084e58a32'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:19 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:19 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" returned: 0 in 0.553s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:19 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7 Apr 14 03:50:19 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:19 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 1G" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ae508-8339-4cda-946d-ed7df2f9087c]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:19 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:19 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:19 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f001c656-2cfe-40ff-90cb-4a0afa69564c tempest-GroupsV314Test-1027090532 None] Delete group completed successfully. Apr 14 03:50:19 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" returned: 0 in 0.496s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "cinder-quobyte-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7" released by "delete_volume" :: held 1.076s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Created reservations ['7f34d04e-80f2-43a8-982a-acf9b6e6fd91', 'a5b6a0b2-c861-4b77-9af2-b7a98b6c3134', 'a0e773ea-e0cc-4ec9-8619-236cc3604f48', 'eee9c2a5-347e-4db1-b2bd-07637fb86f0e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:20 devstack sudo[85099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:20 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:20 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 0.564s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:20 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:20 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:20 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.681s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Deleted volume successfully. Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0f41ed1b-b9e0-4552-8be3-8089d6750f87 tempest-VolumeQuotasNegativeTestJSON-109315803 None] Lock "cinder-79f002b2-fbd4-43fe-8ff8-27d5242a3dd7-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:20 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 1 in 0.682s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Downloaded image 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28 successfully. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 for user f272758b3bce458596b9dee96c604ec2 is deleted. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Marking volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28 as bootable. {{(pid=82370) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Copying metadata from image 561c6fea-555e-40c4-aed9-ba813c6be050 to 42b6d654-8c5a-4d73-8746-802c0e4c2b28. {{(pid=82370) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Creating volume glance metadata for volume 42b6d654-8c5a-4d73-8746-802c0e4c2b28 backed by image 561c6fea-555e-40c4-aed9-ba813c6be050 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82370) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a9d082-0388-48e9-a86e-e965406cc10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76493454-8c8c-4639-b0c5-c69cec593459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:20 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Volume volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 (42b6d654-8c5a-4d73-8746-802c0e4c2b28): created successfully Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76493454-8c8c-4639-b0c5-c69cec593459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Flow 'volume_create_manager' (899a75eb-64db-4526-b835-534dfefd4314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-73faadf8-588e-417f-9fd2-cb47ca3fcf0e tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Created volume successfully. Apr 14 03:50:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:21 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6d646-bdab-41b1-95db-9197205c8284]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:22 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:22 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:22 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 0.702s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:22 devstack sudo[85128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:22 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:23 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 1 in 0.659s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:50:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.396s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2', 'name': 'volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e2c809b-fed0-4f0c-9a51-3b9eef66de09', 'enforce_multipath': True} {{(pid=82370) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 03:50:23 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-f00299ae-d0df-4576-8a3a-0c57660b52a1 req-a787864b-f3be-4f8e-93b0-8bedf2dcd51c tempest-ServerBootFromVolumeStableRescueTest-904746739 None] attachment_update completed successfully. Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Flow 'volume_create_manager' (cc799b7d-a63a-497c-9d9f-a3506e305bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f12ae0-4846-450b-a048-c2098b0f9333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f12ae0-4846-450b-a048-c2098b0f9333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1172635637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b86a20-b56f-409c-a33a-4af4da254b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f55e26679a4d72aebdde247d420ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:25Z,use_quota=True,user_id='6aa5480bfecc46a0b290dba0d466b286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b5f57a-813e-4b38-8e5c-cee96f2a4669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b5f57a-813e-4b38-8e5c-cee96f2a4669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2bf400-70cd-4e23-b5e9-0e6b311c91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2bf400-70cd-4e23-b5e9-0e6b311c91ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b86a20-b56f-409c-a33a-4af4da254b9d', 'volume_name': 'volume-52b86a20-b56f-409c-a33a-4af4da254b9d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29bed75-1d79-41f4-8c3d-f11f9e023d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29bed75-1d79-41f4-8c3d-f11f9e023d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dd72ca-cebe-4876-9c89-0442d51bba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Volume 52b86a20-b56f-409c-a33a-4af4da254b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b86a20-b56f-409c-a33a-4af4da254b9d', 'volume_size': 1} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1172635637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b86a20-b56f-409c-a33a-4af4da254b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f55e26679a4d72aebdde247d420ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:25Z,use_quota=True,user_id='6aa5480bfecc46a0b290dba0d466b286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Creating volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:25 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d 1073741824 Apr 14 03:50:25 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Flow 'volume_create_manager' (37cfdf2b-e67b-4ddc-b249-da227e7f9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c45c7b7-6af2-42f3-a949-efc8337b8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c45c7b7-6af2-42f3-a949-efc8337b8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2048027850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e985db-1c12-443e-b8c0-3753b8dc2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104d2ceaf144595ae4b09e250bf185a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:26Z,use_quota=True,user_id='875c8bb9ee6e4319bbf429286669e7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a5408c-1fe7-4b07-95df-4d75bfb8c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a5408c-1fe7-4b07-95df-4d75bfb8c0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ab9f6d-de28-4506-b2dd-62e80bd24ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ab9f6d-de28-4506-b2dd-62e80bd24ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e985db-1c12-443e-b8c0-3753b8dc2d69', 'volume_name': 'volume-98e985db-1c12-443e-b8c0-3753b8dc2d69', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bf1076-3bb8-4e02-b947-59c0cd19d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bf1076-3bb8-4e02-b947-59c0cd19d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae81f80-4e1e-4d43-8aa9-fd93da7c7ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Volume 98e985db-1c12-443e-b8c0-3753b8dc2d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e985db-1c12-443e-b8c0-3753b8dc2d69', 'volume_size': 1} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:25 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d 1073741824" returned: 0 in 0.644s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:25 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d Apr 14 03:50:25 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:26 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d" returned: 0 in 0.454s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2048027850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e985db-1c12-443e-b8c0-3753b8dc2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104d2ceaf144595ae4b09e250bf185a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:26Z,use_quota=True,user_id='875c8bb9ee6e4319bbf429286669e7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Creating volume 98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:26 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=129,cinder:SELECT=145,cinder:DELETE=2,cinder:INSERT=36 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:50:26 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 1073741824 Apr 14 03:50:26 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dd72ca-cebe-4876-9c89-0442d51bba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b86a20-b56f-409c-a33a-4af4da254b9d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2257c7-67b3-4825-94d9-177ea4488d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=125,cinder:INSERT=32,cinder:UPDATE=134,cinder:DELETE=8 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:50:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Volume volume-52b86a20-b56f-409c-a33a-4af4da254b9d (52b86a20-b56f-409c-a33a-4af4da254b9d): created successfully Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2257c7-67b3-4825-94d9-177ea4488d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Flow 'volume_create_manager' (cc799b7d-a63a-497c-9d9f-a3506e305bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ce2885ef-d632-4293-ac11-976139818cbe tempest-SnapshotsActionsTest-67258113 None] Created volume successfully. Apr 14 03:50:26 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 1073741824" returned: 0 in 0.563s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:26 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 Apr 14 03:50:26 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:27 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae81f80-4e1e-4d43-8aa9-fd93da7c7ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e985db-1c12-443e-b8c0-3753b8dc2d69', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec09b33c-4f42-4e68-bcac-1555d3c44841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Creating offline snapshot 90dbe410-b36c-4db0-8dd0-684723520cfa of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Volume volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 (98e985db-1c12-443e-b8c0-3753b8dc2d69): created successfully Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec09b33c-4f42-4e68-bcac-1555d3c44841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Flow 'volume_create_manager' (37cfdf2b-e67b-4ddc-b249-da227e7f9eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9195f2-0e5e-4453-9e4f-e548ac1e0ab6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:27 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-da01a204-fffa-4f7e-89b2-7b1fc78101ba tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Created volume successfully. Apr 14 03:50:27 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d Apr 14 03:50:27 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:27 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d" returned: 0 in 0.691s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:27 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa 1G Apr 14 03:50:28 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:28 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa 1G" returned: 0 in 0.903s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:28 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:28 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:29 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.624s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:29 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa is being set with open permissions: ugo+rw Apr 14 03:50:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:29 devstack sudo[85241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:29 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:29 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:29 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info Apr 14 03:50:29 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:30 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info" returned: 0 in 0.522s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:30 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info is being set with open permissions: ugo+rw Apr 14 03:50:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:30 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info Apr 14 03:50:30 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:30 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.info" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.809s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.855s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Creating offline snapshot 10f55ac9-26dd-40b0-822a-5fc4d7a9c202 of volume 98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:31 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-aaea9c99-dc9b-4220-a645-683e7b021a06 tempest-SnapshotsActionsTest-67258113 None] Create snapshot completed successfully Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a65f043-dbff-495b-9480-131e840b12c3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:31 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 Apr 14 03:50:31 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:31 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69" returned: 0 in 0.680s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:31 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 1G Apr 14 03:50:31 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:32 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 1G" returned: 0 in 0.856s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:32 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 Apr 14 03:50:32 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:33 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202" returned: 0 in 0.784s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:33 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 is being set with open permissions: ugo+rw Apr 14 03:50:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:33 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 Apr 14 03:50:33 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:33 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:33 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info Apr 14 03:50:33 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:34 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:34 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info is being set with open permissions: ugo+rw Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:34 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info Apr 14 03:50:34 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:34 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.info" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.867s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.053s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Creating offline snapshot 4dd1c594-9833-4b3b-b3e5-145288fa110f of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c60c33ca-7abf-47bd-ae57-6208210eee27 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Create snapshot completed successfully Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f97731-e01d-4c07-84d2-60148f35a2b6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:35 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:35 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:35 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.627s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:35 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f 1G Apr 14 03:50:35 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "cinder-10f55ac9-26dd-40b0-822a-5fc4d7a9c202-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-10f55ac9-26dd-40b0-822a-5fc4d7a9c202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "cinder-quobyte-10f55ac9-26dd-40b0-822a-5fc4d7a9c202" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-10f55ac9-26dd-40b0-822a-5fc4d7a9c202" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Deleting offline snapshot 10f55ac9-26dd-40b0-822a-5fc4d7a9c202 of volume 98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] snapshot_file for this snap is: volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7969a22-35d5-4c8a-9525-d02412820482]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:35 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 Apr 14 03:50:35 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:36 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f 1G" returned: 0 in 0.616s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:36 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f Apr 14 03:50:36 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:36 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202" returned: 0 in 0.673s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e985db-1c12-443e-b8c0-3753b8dc2d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32abcb2-b438-45d1-81f3-343d3bb68ff9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:36 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 Apr 14 03:50:36 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:36 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:36 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f is being set with open permissions: ugo+rw Apr 14 03:50:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:36 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f Apr 14 03:50:36 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:37 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69" returned: 0 in 0.618s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:37 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 Apr 14 03:50:37 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:37 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f" returned: 0 in 0.552s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ec1f75e0-9625-41cf-bbd3-5bfbbbceb335 tempest-SnapshotsActionsTest-67258113 None] Create snapshot completed successfully Apr 14 03:50:37 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:37 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202 Apr 14 03:50:37 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-4dd1c594-9833-4b3b-b3e5-145288fa110f-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-4dd1c594-9833-4b3b-b3e5-145288fa110f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-4dd1c594-9833-4b3b-b3e5-145288fa110f" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-4dd1c594-9833-4b3b-b3e5-145288fa110f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Deleting offline snapshot 4dd1c594-9833-4b3b-b3e5-145288fa110f of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] snapshot_file for this snap is: volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66f7d1-698b-48ce-8075-da2c2ad7393c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:38 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69.10f55ac9-26dd-40b0-822a-5fc4d7a9c202" returned: 0 in 0.656s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-10f55ac9-26dd-40b0-822a-5fc4d7a9c202" released by "_delete_snapshot" :: held 2.572s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" released by "delete_snapshot" :: held 2.584s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:38 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f Apr 14 03:50:38 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:38 devstack cinder-volume[82370]: WARNING cinder.quota [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Created reservations ['7c386ec6-aea6-4192-8e8e-d870f11dfc0a', '15a4e472-ad2d-4890-8eeb-e0d9f936e371', '72d653e2-2fb0-4026-b0f3-1ce825e20ba2', 'fdea5e4c-d093-472e-9be5-4948b6b62e23'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Delete snapshot completed successfully. Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d3c6a58-129b-4161-91b7-772b9c00481d tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-10f55ac9-26dd-40b0-822a-5fc4d7a9c202-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:38 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f" returned: 0 in 0.680s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbeed0f-6021-40d1-ab64-562f72716f78]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "cinder-98e985db-1c12-443e-b8c0-3753b8dc2d69-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-98e985db-1c12-443e-b8c0-3753b8dc2d69-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:39 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:39 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b0157-c044-4d26-a835-1037eaf0eb74]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:39 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 Apr 14 03:50:39 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:39 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.576s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:39 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f Apr 14 03:50:39 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:39 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69" returned: 0 in 0.676s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:39 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69 Apr 14 03:50:39 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:40 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f" returned: 0 in 1.035s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:40 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f Apr 14 03:50:40 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:40 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-98e985db-1c12-443e-b8c0-3753b8dc2d69" returned: 0 in 0.912s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-quobyte-98e985db-1c12-443e-b8c0-3753b8dc2d69" released by "delete_volume" :: held 1.654s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Created reservations ['c4c43620-29fa-4cfb-a83d-aa4532183bcf', '4ab6e4c0-9733-4785-ac27-4a2d426dc605', '1d0c1e64-07cd-4404-a61f-70df828b7361', 'cb31275a-dd00-4dcd-86f7-c7a1d74ad65e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:40 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:40 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:41 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.4dd1c594-9833-4b3b-b3e5-145288fa110f" returned: 0 in 0.573s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-4dd1c594-9833-4b3b-b3e5-145288fa110f" released by "_delete_snapshot" :: held 2.920s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_snapshot" :: held 2.935s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Created reservations ['064e4c03-22d8-4bd5-9b1a-c1ad886bd27b', 'd81cafd5-f2ad-406f-957b-3ee83fb2b4cd', 'ecfef9f8-8bc5-4b90-8fc1-69ac63ef1769', 'd2d9ec09-1a5d-4e5f-ba9a-bba05184a302'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:41 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.598s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:41 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Deleted volume successfully. Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d20815a7-cb0d-43e3-ac37-1c8524d028a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-872508008 None] Lock "cinder-98e985db-1c12-443e-b8c0-3753b8dc2d69-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:41 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Delete snapshot completed successfully. Apr 14 03:50:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2d09a2dc-eb4a-4acb-aa1c-79545ddc93c0 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-4dd1c594-9833-4b3b-b3e5-145288fa110f-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:42 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Creating offline snapshot cb0c0241-636c-4397-a785-b1def95b84f9 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:42 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6b4344-ad94-4a32-be3b-ee3516b22806]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:42 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:42 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:43 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.958s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:43 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 1G Apr 14 03:50:43 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:45 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 1G" returned: 0 in 1.481s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:45 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 Apr 14 03:50:45 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:46 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9" returned: 0 in 1.160s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:46 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 is being set with open permissions: ugo+rw Apr 14 03:50:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:46 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 Apr 14 03:50:46 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:47 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9" returned: 0 in 1.213s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.977s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-47529e0b-5c74-42bf-a39b-74150cb6d536 tempest-SnapshotsActionsTest-67258113 None] Create snapshot completed successfully Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-cb0c0241-636c-4397-a785-b1def95b84f9-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-cb0c0241-636c-4397-a785-b1def95b84f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-cb0c0241-636c-4397-a785-b1def95b84f9" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-cb0c0241-636c-4397-a785-b1def95b84f9" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Deleting offline snapshot cb0c0241-636c-4397-a785-b1def95b84f9 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] snapshot_file for this snap is: volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a965e1-a593-46ed-96f5-610a6702545a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:48 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 Apr 14 03:50:48 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:49 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9" returned: 0 in 1.199s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadeb509-1503-4344-853c-563798a9368c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:50 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:50 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Flow 'volume_create_manager' (b43a155b-a97b-4741-80c0-cb9f7e06c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f5a6c7-55b3-4e77-bf80-f4cb93811fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f5a6c7-55b3-4e77-bf80-f4cb93811fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1303740757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f93097-b009-487e-b182-0b676c6e1413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbcc55b85c342bf8b8b75f3593a29e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:51Z,use_quota=True,user_id='df6eadcf71b847e6a67d4b414f8279de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5162ced-577b-4009-8f04-8148b63212d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5162ced-577b-4009-8f04-8148b63212d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509f74d3-6b83-4e92-9aa3-fd563405ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509f74d3-6b83-4e92-9aa3-fd563405ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f93097-b009-487e-b182-0b676c6e1413', 'volume_name': 'volume-44f93097-b009-487e-b182-0b676c6e1413', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f219f97-5a6d-45e1-9344-53e66ce01964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f219f97-5a6d-45e1-9344-53e66ce01964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acefcda-791f-4ec5-a106-be101afc5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Volume 44f93097-b009-487e-b182-0b676c6e1413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f93097-b009-487e-b182-0b676c6e1413', 'volume_size': 1} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1303740757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f93097-b009-487e-b182-0b676c6e1413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbcc55b85c342bf8b8b75f3593a29e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:51Z,use_quota=True,user_id='df6eadcf71b847e6a67d4b414f8279de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Creating volume 44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:50 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:50 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 1073741824 Apr 14 03:50:50 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:50 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.802s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:50 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 Apr 14 03:50:50 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:51 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:51 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9" returned: 0 in 0.682s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 1073741824" returned: 0 in 0.808s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:51 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9 Apr 14 03:50:51 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:51 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 Apr 14 03:50:51 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:51 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.cb0c0241-636c-4397-a785-b1def95b84f9" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-cb0c0241-636c-4397-a785-b1def95b84f9" released by "_delete_snapshot" :: held 3.289s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_snapshot" :: held 3.346s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:51 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Created reservations ['2f7125ef-5760-4403-81c2-4f7d68e90dcd', '46afb974-5c79-4a26-af5b-a12fdfcf8b08', 'f35bf0e2-fd0d-4969-864a-0ebf04e5f4f6', '2c3a8dd8-ef11-4fd8-96b9-cfc4c8e7967e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Delete snapshot completed successfully. Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-de6211a4-fe4c-4ded-a188-7799996aada6 tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-cb0c0241-636c-4397-a785-b1def95b84f9-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:52 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413" returned: 0 in 0.532s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acefcda-791f-4ec5-a106-be101afc5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f93097-b009-487e-b182-0b676c6e1413', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a100467-0652-4121-87fe-cfcf7389f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:52 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Volume volume-44f93097-b009-487e-b182-0b676c6e1413 (44f93097-b009-487e-b182-0b676c6e1413): created successfully Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a100467-0652-4121-87fe-cfcf7389f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Flow 'volume_create_manager' (b43a155b-a97b-4741-80c0-cb9f7e06c59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d1213971-1b0a-4f58-b740-223b30c22f8f tempest-SnapshotMetadataTestJSON-182549440 None] Created volume successfully. Apr 14 03:50:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-8a051ba6-82d4-4295-a717-88f2032fe2fd tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Terminate volume connection completed successfully. Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-8a051ba6-82d4-4295-a717-88f2032fe2fd tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Deleting attachment 9e2c809b-fed0-4f0c-9a51-3b9eef66de09. {{(pid=82370) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Creating offline snapshot 54af906b-20c2-473f-bf3c-4535f6f59ca8 of volume 44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "cinder-42b6d654-8c5a-4d73-8746-802c0e4c2b28-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-42b6d654-8c5a-4d73-8746-802c0e4c2b28-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[189740dc-5224-4716-b4bd-ffb8f9d7952d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "cinder-quobyte-42b6d654-8c5a-4d73-8746-802c0e4c2b28" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-quobyte-42b6d654-8c5a-4d73-8746-802c0e4c2b28" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d9456-00f3-4f41-a4db-ad9c38beaf28]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:53 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 Apr 14 03:50:53 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:53 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:53 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:53 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413" returned: 0 in 0.551s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:53 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 1G Apr 14 03:50:53 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:53 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:53 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:53 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:54 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 1G" returned: 0 in 0.625s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f93097-b009-487e-b182-0b676c6e1413 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:54 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f93097-b009-487e-b182-0b676c6e1413 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 Apr 14 03:50:54 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:54 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 1 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:54 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28 Apr 14 03:50:54 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:54 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44f93097-b009-487e-b182-0b676c6e1413 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:54 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 is being set with open permissions: ugo+rw Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:54 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-42b6d654-8c5a-4d73-8746-802c0e4c2b28" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-quobyte-42b6d654-8c5a-4d73-8746-802c0e4c2b28" released by "delete_volume" :: held 1.618s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:54 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 Apr 14 03:50:54 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG cinder.quota [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Created reservations ['4929fe8d-f7ce-46b6-8220-f408d46a67cd', '9abf124d-7bee-47bd-9231-9990648358c5', '8b805b98-a2cc-41e3-8cb0-322d1b4eefc7', 'c7fc9826-a8df-414d-82ac-d9e3b1f75512'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:54 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:54 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:55 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.manager [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:55 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Deleted volume successfully. Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-15195bd4-0edb-47a5-92c4-1dd7507dc129 req-c0aba735-6798-46de-8a55-309990780e62 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-42b6d654-8c5a-4d73-8746-802c0e4c2b28-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:50:55 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8" returned: 0 in 0.660s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:55 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info Apr 14 03:50:55 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Flow 'volume_create_manager' (94bf0e00-7686-4f72-83e5-6b92ada5f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d460064b-ae92-4b0a-aa4a-daa39f059467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d460064b-ae92-4b0a-aa4a-daa39f059467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-759696908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed6bb48-e660-4cdd-ae42-8ea39d5b858d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54f423b24e84ecbb40f91f1dd2eaf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:55Z,use_quota=True,user_id='3473d016a62e4cdb88e0529f77b7a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89da083-559f-4434-a983-72be6c2f5abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89da083-559f-4434-a983-72be6c2f5abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067fba89-88e9-4579-8472-594d9b999d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067fba89-88e9-4579-8472-594d9b999d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed6bb48-e660-4cdd-ae42-8ea39d5b858d', 'volume_name': 'volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e7c9a-5413-4c7e-b23f-16e2c5e59c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e7c9a-5413-4c7e-b23f-16e2c5e59c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c0e6ea-cabd-413e-aa55-2cdb65c7ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:50:55 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Volume fed6bb48-e660-4cdd-ae42-8ea39d5b858d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d', 'volume_size': 1} Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:55 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info" returned: 0 in 0.448s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:55 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info is being set with open permissions: ugo+rw Apr 14 03:50:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:55 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info Apr 14 03:50:55 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:56 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.info" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.265s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.935s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Creating offline snapshot 0f2436c3-0e48-4ef3-a3a9-ed166801cf52 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e298a7-5d93-461a-b8a6-3d58e64bf9ae]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:56 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8835b1a6-8d11-4c6a-9edf-1a9f42720d50 tempest-SnapshotMetadataTestJSON-182549440 None] Create snapshot completed successfully Apr 14 03:50:56 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:50:56 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:56 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.579s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:56 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 1G Apr 14 03:50:56 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:57 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 1G" returned: 0 in 0.615s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:57 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 Apr 14 03:50:57 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "cinder-54af906b-20c2-473f-bf3c-4535f6f59ca8-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-54af906b-20c2-473f-bf3c-4535f6f59ca8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "cinder-quobyte-54af906b-20c2-473f-bf3c-4535f6f59ca8" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-54af906b-20c2-473f-bf3c-4535f6f59ca8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Deleting offline snapshot 54af906b-20c2-473f-bf3c-4535f6f59ca8 of volume 44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] snapshot_file for this snap is: volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f9eda-517e-4d5d-9aa5-983b0f61726c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:57 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 Apr 14 03:50:57 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:58 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52" returned: 0 in 0.736s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:58 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 is being set with open permissions: ugo+rw Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:58 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 Apr 14 03:50:58 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:58 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8" returned: 0 in 0.634s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44f93097-b009-487e-b182-0b676c6e1413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b80a1-4efc-454b-9346-c384e5d5471d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:58 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 Apr 14 03:50:58 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:58 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.177s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-759696908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed6bb48-e660-4cdd-ae42-8ea39d5b858d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54f423b24e84ecbb40f91f1dd2eaf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:50:55Z,use_quota=True,user_id='3473d016a62e4cdb88e0529f77b7a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Creating volume fed6bb48-e660-4cdd-ae42-8ea39d5b858d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:50:58 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2bcbe458-335a-414e-aefa-bab4da7b4c11 tempest-SnapshotsActionsTest-67258113 None] Create snapshot completed successfully Apr 14 03:50:58 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d 1073741824 Apr 14 03:50:58 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:58 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413" returned: 0 in 0.525s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:58 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 Apr 14 03:50:58 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:50:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:58 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:50:58 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:59 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d 1073741824" returned: 0 in 0.574s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:59 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d Apr 14 03:50:59 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:59 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.606s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-0f2436c3-0e48-4ef3-a3a9-ed166801cf52-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-0f2436c3-0e48-4ef3-a3a9-ed166801cf52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-0f2436c3-0e48-4ef3-a3a9-ed166801cf52" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-0f2436c3-0e48-4ef3-a3a9-ed166801cf52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:50:59 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Deleting offline snapshot 0f2436c3-0e48-4ef3-a3a9-ed166801cf52 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] snapshot_file for this snap is: volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8" returned: 0 in 0.926s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0493f793-96a7-4766-8d8e-babcae02cdef]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:50:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:50:59 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8 Apr 14 03:50:59 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:50:59 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 Apr 14 03:50:59 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:00 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" returned: 0 in 0.851s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c0e6ea-cabd-413e-aa55-2cdb65c7ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbc340d-3825-4b38-a286-d44a4b7bf53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Volume volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d (fed6bb48-e660-4cdd-ae42-8ea39d5b858d): created successfully Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbc340d-3825-4b38-a286-d44a4b7bf53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Flow 'volume_create_manager' (94bf0e00-7686-4f72-83e5-6b92ada5f012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6a935ecb-760b-495e-9ed2-8ebba5abc673 tempest-ServersNegativeTestJSON-1121673680 None] Created volume successfully. Apr 14 03:51:00 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413.54af906b-20c2-473f-bf3c-4535f6f59ca8" returned: 0 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-54af906b-20c2-473f-bf3c-4535f6f59ca8" released by "_delete_snapshot" :: held 2.712s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" released by "delete_snapshot" :: held 2.726s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:00 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52" returned: 0 in 0.620s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba21493f-469b-4aca-81f1-90e6d17eb74b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Created reservations ['cd7c9eda-9a8f-4a75-8da0-c4d357b9a7dc', '1ac871ee-01b6-4ba4-8613-40a1744229a7', '7398b9f6-9a7b-4243-b0c1-3e44c8666269', '2d351ddf-1431-4635-a776-01843ba6e219'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Delete snapshot completed successfully. Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-38c9c00b-985f-40e0-9263-c1b102f070c7 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-54af906b-20c2-473f-bf3c-4535f6f59ca8-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:00 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:00 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "cinder-44f93097-b009-487e-b182-0b676c6e1413-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-44f93097-b009-487e-b182-0b676c6e1413-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec1e2a-c91e-437a-a487-b2eb36fef0ac]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:01 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 Apr 14 03:51:01 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:01 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.669s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:01 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 Apr 14 03:51:01 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:01 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413" returned: 0 in 0.628s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:01 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413 Apr 14 03:51:01 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Flow 'volume_create_manager' (690a8e4c-acb3-487e-8851-f1c65d8fdff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340bd64c-24d3-4b8e-861c-036e9895a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:01 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340bd64c-24d3-4b8e-861c-036e9895a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1455471660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1836af-f6ea-4007-84d1-979bd5e889af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54f423b24e84ecbb40f91f1dd2eaf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:02Z,use_quota=True,user_id='3473d016a62e4cdb88e0529f77b7a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53107600-72c5-40b5-9e07-91e90ab1ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53107600-72c5-40b5-9e07-91e90ab1ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b0e316-3545-485a-b561-e85f68baa4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b0e316-3545-485a-b561-e85f68baa4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1836af-f6ea-4007-84d1-979bd5e889af', 'volume_name': 'volume-bd1836af-f6ea-4007-84d1-979bd5e889af', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93edc162-749a-4696-b21c-fc78dbf31768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93edc162-749a-4696-b21c-fc78dbf31768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a87736a-4459-43e6-ba8d-182c2bd23376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Volume bd1836af-f6ea-4007-84d1-979bd5e889af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1836af-f6ea-4007-84d1-979bd5e889af', 'volume_size': 1} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1455471660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1836af-f6ea-4007-84d1-979bd5e889af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54f423b24e84ecbb40f91f1dd2eaf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:02Z,use_quota=True,user_id='3473d016a62e4cdb88e0529f77b7a904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Creating volume bd1836af-f6ea-4007-84d1-979bd5e889af {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:01 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52" returned: 0 in 0.754s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:01 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af 1073741824 Apr 14 03:51:01 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:01 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52 Apr 14 03:51:01 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:02 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-44f93097-b009-487e-b182-0b676c6e1413" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-quobyte-44f93097-b009-487e-b182-0b676c6e1413" released by "delete_volume" :: held 1.220s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Created reservations ['1326407c-eae1-4cb5-afc5-6f6ac3a19a4f', 'c949a36f-7bd0-441a-9d4a-c6e26f6a61f7', '1163f2f1-dc71-4528-9991-a92edafb03c8', '562944bc-18ec-4100-9eaa-cc137e309865'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:02 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:02 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:02 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.0f2436c3-0e48-4ef3-a3a9-ed166801cf52" returned: 0 in 0.451s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-0f2436c3-0e48-4ef3-a3a9-ed166801cf52" released by "_delete_snapshot" :: held 2.562s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_snapshot" :: held 2.586s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Created reservations ['45bed1f4-9da1-4e48-8328-816ad2380013', '2c924958-b3d4-4a7d-abcf-3c3422cc9415', '471a4369-ac4b-4bb1-ae28-72dd8151f613', '048477e6-8a40-4d1c-a4b9-86430c5cd164'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Delete snapshot completed successfully. Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b6543e3-c07a-4e9d-84d8-7e1804c72fba tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-0f2436c3-0e48-4ef3-a3a9-ed166801cf52-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:02 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af 1073741824" returned: 0 in 0.583s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:02 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af Apr 14 03:51:02 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:02 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.458s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Deleted volume successfully. Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-04425c48-bbc3-419d-8516-a137a2b489e5 tempest-SnapshotMetadataTestJSON-182549440 None] Lock "cinder-44f93097-b009-487e-b182-0b676c6e1413-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:02 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af" returned: 0 in 0.441s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a87736a-4459-43e6-ba8d-182c2bd23376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1836af-f6ea-4007-84d1-979bd5e889af', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df0fd77-a818-416d-ae2b-6401f2c302b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:02 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Volume volume-bd1836af-f6ea-4007-84d1-979bd5e889af (bd1836af-f6ea-4007-84d1-979bd5e889af): created successfully Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df0fd77-a818-416d-ae2b-6401f2c302b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Flow 'volume_create_manager' (690a8e4c-acb3-487e-8851-f1c65d8fdff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4c54b1c3-9296-4de4-8f6c-b272fe54dc2d tempest-ServersNegativeTestJSON-1121673680 None] Created volume successfully. Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Creating offline snapshot 3c11162a-6236-4e76-9d5b-c84dd121f063 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0253eb3-6d30-4afe-abd0-52a32a2664a8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:03 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:03 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:03 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.609s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:03 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 1G Apr 14 03:51:03 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "cinder-bd1836af-f6ea-4007-84d1-979bd5e889af-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-bd1836af-f6ea-4007-84d1-979bd5e889af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "cinder-quobyte-bd1836af-f6ea-4007-84d1-979bd5e889af" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-quobyte-bd1836af-f6ea-4007-84d1-979bd5e889af" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b80ac7-556b-4520-b7dc-79e93a48d08a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:04 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af Apr 14 03:51:04 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:04 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 1G" returned: 0 in 0.753s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:04 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 Apr 14 03:51:04 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:04 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af" returned: 0 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:04 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af Apr 14 03:51:04 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:05 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063" returned: 0 in 0.628s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:05 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 is being set with open permissions: ugo+rw Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:05 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 Apr 14 03:51:05 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:05 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-bd1836af-f6ea-4007-84d1-979bd5e889af" returned: 0 in 0.557s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-quobyte-bd1836af-f6ea-4007-84d1-979bd5e889af" released by "delete_volume" :: held 1.179s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Created reservations ['c50922d2-57ff-41a9-97ba-28499fde790f', '69f29e15-a7cf-4d4a-af63-44e0d769b1a8', 'be3d960d-6b74-40b8-b2b3-6034da15cd6d', '29960705-9396-4a60-8ec3-669295ed164b'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:05 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:05 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:05 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063" returned: 0 in 0.721s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-503cef9a-30c1-4577-848c-2e8cfcbbadb0 tempest-SnapshotsActionsTest-67258113 None] Create snapshot completed successfully Apr 14 03:51:06 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.508s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Deleted volume successfully. Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-29db0c48-a3a3-416a-a1e8-896a71edae2d tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-bd1836af-f6ea-4007-84d1-979bd5e889af-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-3c11162a-6236-4e76-9d5b-c84dd121f063-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-3c11162a-6236-4e76-9d5b-c84dd121f063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Acquiring lock "cinder-quobyte-3c11162a-6236-4e76-9d5b-c84dd121f063" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-3c11162a-6236-4e76-9d5b-c84dd121f063" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Deleting offline snapshot 3c11162a-6236-4e76-9d5b-c84dd121f063 of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] snapshot_file for this snap is: volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c96d29-ed4a-494a-927b-0971150f98de]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:06 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 Apr 14 03:51:06 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Flow 'volume_create_manager' (1e991bca-3d3c-4245-b357-14d4f4e977a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cb3576-2bdb-4aa5-b1bd-b6300e31ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "cinder-fed6bb48-e660-4cdd-ae42-8ea39d5b858d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cb3576-2bdb-4aa5-b1bd-b6300e31ff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2135189378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdc9447-1c0d-4430-9cd2-b71421dee8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de388cd5f2f4d14b31b7799b08bce50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:06Z,use_quota=True,user_id='f8aefb72c65a4fb39cfce22d1e8e82d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ec85a-788c-40ff-a1bd-cbc6bed0aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ec85a-788c-40ff-a1bd-cbc6bed0aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923110e6-e383-44eb-b885-53dc4605d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923110e6-e383-44eb-b885-53dc4605d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdc9447-1c0d-4430-9cd2-b71421dee8a0', 'volume_name': 'volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf759ae-ec18-4a59-99d1-caa04f81a1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf759ae-ec18-4a59-99d1-caa04f81a1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c249c6c-d618-48ed-a9f4-0be4ab2f6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:06 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Volume cbdc9447-1c0d-4430-9cd2-b71421dee8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0', 'volume_size': 1} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2135189378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdc9447-1c0d-4430-9cd2-b71421dee8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de388cd5f2f4d14b31b7799b08bce50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:06Z,use_quota=True,user_id='f8aefb72c65a4fb39cfce22d1e8e82d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Creating volume cbdc9447-1c0d-4430-9cd2-b71421dee8a0 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:06 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-fed6bb48-e660-4cdd-ae42-8ea39d5b858d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:06 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 1073741824 Apr 14 03:51:06 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "cinder-quobyte-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-quobyte-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a1f438-257f-4a11-82a6-dd6cb5304f4a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:06 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d Apr 14 03:51:06 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:06 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063" returned: 0 in 0.528s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6b3533-1372-4c2d-9a9e-04ae3bb2f5c8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:07 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:07 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:07 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 1073741824" returned: 0 in 0.594s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:07 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" returned: 0 in 0.546s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:07 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d Apr 14 03:51:07 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:07 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 Apr 14 03:51:07 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:07 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.564s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:07 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 Apr 14 03:51:07 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:07 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-quobyte-fed6bb48-e660-4cdd-ae42-8ea39d5b858d" released by "delete_volume" :: held 1.001s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Created reservations ['90891afd-31ee-4da8-abf4-b07ad17a1f31', '59a6d460-ff57-4699-9606-49f30e093e53', '14379625-6525-40fe-99c2-f9376b6fccf8', '53738db0-825b-4c05-ad78-e41e93740483'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:07 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" returned: 0 in 0.496s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c249c6c-d618-48ed-a9f4-0be4ab2f6c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:07 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:07 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba424e7-e513-4722-9920-b82c4efb233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Volume volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 (cbdc9447-1c0d-4430-9cd2-b71421dee8a0): created successfully Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba424e7-e513-4722-9920-b82c4efb233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Flow 'volume_create_manager' (1e991bca-3d3c-4245-b357-14d4f4e977a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:07 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cab26463-5fc9-4653-91af-7cbbe81a465a tempest-VolumesTransfersTest-44268895 None] Created volume successfully. Apr 14 03:51:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-ba6e0af2-88e6-43bd-ba89-13142a842f7b tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Terminate volume connection completed successfully. Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-ba6e0af2-88e6-43bd-ba89-13142a842f7b tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Deleting attachment 88fc6401-8fec-4970-bb8b-277f7f5e5e8e. {{(pid=82370) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:51:08 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063" returned: 0 in 0.527s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:08 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063 Apr 14 03:51:08 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:08 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Deleted volume successfully. Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b3884481-7143-4ed5-8440-60f16c2ee776 tempest-ServersNegativeTestJSON-1121673680 None] Lock "cinder-fed6bb48-e660-4cdd-ae42-8ea39d5b858d-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:08 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.3c11162a-6236-4e76-9d5b-c84dd121f063" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-3c11162a-6236-4e76-9d5b-c84dd121f063" released by "_delete_snapshot" :: held 2.094s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_snapshot" :: held 2.105s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Created reservations ['27d6d525-2dc7-457b-afec-3404b3260442', 'd358a890-3d57-4cc0-b07c-8dbb910c98b5', 'cda90315-7515-4d31-9206-94c5dec4ea77', '4f5e42bc-d4ee-4715-87c3-bd4f503d6327'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Delete snapshot completed successfully. Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9e23dcd0-9edb-41ce-bf8a-991cc757468d tempest-SnapshotsActionsTest-988748116 None] Lock "cinder-3c11162a-6236-4e76-9d5b-c84dd121f063-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "cinder-34707879-b9fa-4eeb-990e-3dfec91a4212-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-34707879-b9fa-4eeb-990e-3dfec91a4212-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "cinder-quobyte-34707879-b9fa-4eeb-990e-3dfec91a4212" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-quobyte-34707879-b9fa-4eeb-990e-3dfec91a4212" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b59762-0974-491b-aab9-66bc3a8a38f9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:08 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 Apr 14 03:51:08 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-07b82ef6-9f32-4b77-932b-bdd3c83562bf tempest-VolumesTransfersTest-1484281298 None] Transfer volume completed successfully. Apr 14 03:51:09 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212" returned: 0 in 0.559s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:09 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212 Apr 14 03:51:09 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "cinder-90dbe410-b36c-4db0-8dd0-684723520cfa-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:09 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-34707879-b9fa-4eeb-990e-3dfec91a4212" returned: 0 in 0.473s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-quobyte-34707879-b9fa-4eeb-990e-3dfec91a4212" released by "delete_volume" :: held 1.072s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-90dbe410-b36c-4db0-8dd0-684723520cfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "cinder-quobyte-90dbe410-b36c-4db0-8dd0-684723520cfa" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-90dbe410-b36c-4db0-8dd0-684723520cfa" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Deleting offline snapshot 90dbe410-b36c-4db0-8dd0-684723520cfa of volume 52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] snapshot_file for this snap is: volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf84123-43df-4dd8-9906-399ee54ac982]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.quota [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Created reservations ['48ac9f44-5294-4c0f-8844-7fba57eaa50a', 'cee220a7-be13-4f3e-84b4-3360bcff4238', 'c07a63bc-4ee7-468d-8469-7ac5f3786b65', '8e63e12a-59fc-4988-b8e2-d0c17ec0dc4c'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:09 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:09 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "cinder-cbdc9447-1c0d-4430-9cd2-b71421dee8a0-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:09 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:09 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-cbdc9447-1c0d-4430-9cd2-b71421dee8a0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "cinder-quobyte-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-quobyte-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cfdf3-ef15-469a-b1b4-eb89b4cb853c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:10 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 Apr 14 03:51:10 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:10 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.716s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b86a20-b56f-409c-a33a-4af4da254b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[27223f43-6414-4c09-a66c-ba4427cd0295]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:10 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d Apr 14 03:51:10 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:10 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.692s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG cinder.manager [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Deleted volume successfully. Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-fd90c732-7104-45fe-8b20-462cc32adc0a req-b2fb64f7-4a5b-47cf-a013-fa203c39f272 tempest-ServerBootFromVolumeStableRescueTest-904746739 None] Lock "cinder-34707879-b9fa-4eeb-990e-3dfec91a4212-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:10 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" returned: 0 in 0.600s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:10 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0 Apr 14 03:51:10 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:11 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d" returned: 0 in 0.525s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:11 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:11 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:11 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-quobyte-cbdc9447-1c0d-4430-9cd2-b71421dee8a0" released by "delete_volume" :: held 1.085s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Created reservations ['aee0215f-e2c6-47fd-a97a-99e662f19755', 'f1c6273f-f38c-4869-8530-6a4303240d06', '794a9bb2-0f3f-4a7d-9799-4bb73a0fb5d7', '0ba1fac5-023d-44b8-b560-61cf2a205f94'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:11 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:11 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:11 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:11 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa Apr 14 03:51:11 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:11 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.568s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:11 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Deleted volume successfully. Apr 14 03:51:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a18b252c-8fd8-4e15-9a38-1bf55245c419 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-cbdc9447-1c0d-4430-9cd2-b71421dee8a0-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:12 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d.90dbe410-b36c-4db0-8dd0-684723520cfa" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-90dbe410-b36c-4db0-8dd0-684723520cfa" released by "_delete_snapshot" :: held 2.349s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_snapshot" :: held 2.364s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Created reservations ['c38b52ab-28da-42e6-8660-3956f2dcd6d1', '4edf77e5-f35f-441d-b877-33de053336df', '55302185-f6bb-446e-b873-701aefa46e68', '94df3830-ced4-4a29-a15b-de7751024175'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Delete snapshot completed successfully. Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e4e7d02f-b188-4653-ad48-371e1b567cd4 tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-90dbe410-b36c-4db0-8dd0-684723520cfa-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Flow 'volume_create_manager' (71b97184-3fe1-4578-96fd-cf365eadd2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d89d4c-ceb7-4177-9967-d4f0dad89144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d89d4c-ceb7-4177-9967-d4f0dad89144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765142138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de388cd5f2f4d14b31b7799b08bce50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:12Z,use_quota=True,user_id='f8aefb72c65a4fb39cfce22d1e8e82d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d0dfc8-a7db-4a09-8ea6-b9b7a94c14ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d0dfc8-a7db-4a09-8ea6-b9b7a94c14ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d3596-a714-406d-91e5-afd3f35bfc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d3596-a714-406d-91e5-afd3f35bfc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49', 'volume_name': 'volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b3369d-e382-4cee-9736-708cd1afdddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b3369d-e382-4cee-9736-708cd1afdddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2ddf33-458c-4848-a2ca-584ce9da36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:12 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Volume da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49', 'volume_size': 1} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1765142138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de388cd5f2f4d14b31b7799b08bce50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:12Z,use_quota=True,user_id='f8aefb72c65a4fb39cfce22d1e8e82d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Creating volume da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:12 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:12 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 1073741824 Apr 14 03:51:12 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "cinder-52b86a20-b56f-409c-a33a-4af4da254b9d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-52b86a20-b56f-409c-a33a-4af4da254b9d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" acquired by "delete_volume" :: waited 0.022s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e20d1-a707-46ca-bed2-225f83ca61d5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:13 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 1073741824" returned: 0 in 0.602s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:13 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 Apr 14 03:51:13 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:13 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d Apr 14 03:51:13 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:13 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2ddf33-458c-4848-a2ca-584ce9da36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a792d9-22d8-4f61-a002-5f8119616cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:13 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Volume volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 (da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49): created successfully Apr 14 03:51:13 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a792d9-22d8-4f61-a002-5f8119616cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Flow 'volume_create_manager' (71b97184-3fe1-4578-96fd-cf365eadd2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d" returned: 0 in 0.615s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a6af7a42-3c89-4651-a769-85d81487cd0a tempest-VolumesTransfersTest-44268895 None] Created volume successfully. Apr 14 03:51:13 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d Apr 14 03:51:13 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:14 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-52b86a20-b56f-409c-a33a-4af4da254b9d" returned: 0 in 0.408s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-quobyte-52b86a20-b56f-409c-a33a-4af4da254b9d" released by "delete_volume" :: held 1.056s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Created reservations ['5582be64-f3b1-4b73-8db3-af6a618834ca', 'e3be0ae5-3220-48d3-b082-8ba643356403', '90bf2356-6f80-4dd9-9610-143ab352e5b8', '5b11fd7a-49e8-4ccb-a5b3-917702148c53'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:14 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:14 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:14 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.500s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Deleted volume successfully. Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b693b60c-eded-4e1d-ba31-249d2ac205ec tempest-SnapshotsActionsTest-67258113 None] Lock "cinder-52b86a20-b56f-409c-a33a-4af4da254b9d-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "cinder-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "cinder-quobyte-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-quobyte-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75438a-339c-49ac-a200-d8b7bbcc85e5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:14 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 Apr 14 03:51:14 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:15 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" returned: 0 in 0.560s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:15 devstack sudo[86078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49 Apr 14 03:51:15 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:15 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" returned: 0 in 0.537s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-quobyte-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49" released by "delete_volume" :: held 1.121s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:15 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Created reservations ['df29c422-4bbf-4bd8-b70f-7859c7a2bd7d', 'dd654f86-0a39-42c1-ad0f-6237620b1c1c', '9ed313b0-0e1b-4683-b8b2-cff0881053b5', '30744034-c839-4a62-b66f-35ec93cc7cdd'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:16 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:16 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:16 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Deleted volume successfully. Apr 14 03:51:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-91a89e85-8121-47b9-a0bb-fb52c703dfd2 tempest-VolumesTransfersTest-1670035448 None] Lock "cinder-da6fe6c3-9f7d-4716-ba5d-ef0a6fa32b49-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (6d70f8df-7a1b-4471-be99-4192854e8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79787b4-acdf-485a-8bdf-1b22ff11dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79787b4-acdf-485a-8bdf-1b22ff11dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-708866633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f91251-9b7d-4030-9dc8-794e167e2eb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:20Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16724a98-2806-4c75-8e77-2a0f3cb8f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16724a98-2806-4c75-8e77-2a0f3cb8f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7127951d-6806-4cc1-88c7-88e01622beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7127951d-6806-4cc1-88c7-88e01622beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f91251-9b7d-4030-9dc8-794e167e2eb8', 'volume_name': 'volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d405e6-b3b8-40b8-ac55-a073dfc9ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d405e6-b3b8-40b8-ac55-a073dfc9ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa78d3-faef-4b1e-be58-efc6ade67a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:20 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Volume d4f91251-9b7d-4030-9dc8-794e167e2eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8', 'volume_size': 1} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-708866633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f91251-9b7d-4030-9dc8-794e167e2eb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:20Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Creating volume d4f91251-9b7d-4030-9dc8-794e167e2eb8 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:20 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:20 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 1073741824 Apr 14 03:51:20 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:20 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 1073741824" returned: 0 in 0.657s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:20 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 Apr 14 03:51:20 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:21 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8" returned: 0 in 0.546s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baa78d3-faef-4b1e-be58-efc6ade67a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739cbe28-791d-4b9f-abb1-b59af46e3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:21 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Volume volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 (d4f91251-9b7d-4030-9dc8-794e167e2eb8): created successfully Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739cbe28-791d-4b9f-abb1-b59af46e3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (6d70f8df-7a1b-4471-be99-4192854e8373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:21 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-48a93ae0-5c2e-4ee9-928f-e1ef4e0e620a tempest-VolumesTestJSON-743857950 None] Created volume successfully. Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (fc013369-47ed-40c7-9df0-1dae1d4a34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a7f244-cff4-4db1-ac8c-49ad66cc75a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a7f244-cff4-4db1-ac8c-49ad66cc75a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378852544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95759e4-07ac-4853-bead-d06467587b69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:23Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693841e1-12bb-4096-a1d4-b99c3c89bccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693841e1-12bb-4096-a1d4-b99c3c89bccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ba311f-0d61-4cb6-97e1-05b178b070ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ba311f-0d61-4cb6-97e1-05b178b070ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95759e4-07ac-4853-bead-d06467587b69', 'volume_name': 'volume-a95759e4-07ac-4853-bead-d06467587b69', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2d03eb-95a7-4a6a-ac19-088f87b205ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2d03eb-95a7-4a6a-ac19-088f87b205ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23b3329-b0d5-4ec4-b3e4-527217f37aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:22 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Volume a95759e4-07ac-4853-bead-d06467587b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95759e4-07ac-4853-bead-d06467587b69', 'volume_size': 1} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378852544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95759e4-07ac-4853-bead-d06467587b69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:23Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Creating volume a95759e4-07ac-4853-bead-d06467587b69 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:22 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:22 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 1073741824 Apr 14 03:51:22 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:23 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 1073741824" returned: 0 in 0.624s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:23 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 Apr 14 03:51:23 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:23 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Flow 'volume_create_manager' (02de0f8e-9885-425e-b59a-f6e524182a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1adcb0-3242-43a9-a650-a934bccfb80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69" returned: 0 in 0.639s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1adcb0-3242-43a9-a650-a934bccfb80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1213999132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8e3c29-e59b-4a82-9b69-bb51fd9540c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c918ea712f846fd8f567255b42872b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:24Z,use_quota=True,user_id='e86880a450d449ceb2d0cec90e228256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b70663-f036-40a5-ac6c-7663fa4e96f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b70663-f036-40a5-ac6c-7663fa4e96f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5639ace4-6bf0-4eb5-b2fa-a8b17f705d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5639ace4-6bf0-4eb5-b2fa-a8b17f705d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8e3c29-e59b-4a82-9b69-bb51fd9540c5', 'volume_name': 'volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c355d5-ee1f-491a-a68c-bfb2658eac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c355d5-ee1f-491a-a68c-bfb2658eac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b825f4c4-faac-41aa-b198-c88e31da97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Volume 2f8e3c29-e59b-4a82-9b69-bb51fd9540c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5', 'volume_size': 1} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1213999132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8e3c29-e59b-4a82-9b69-bb51fd9540c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c918ea712f846fd8f567255b42872b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:24Z,use_quota=True,user_id='e86880a450d449ceb2d0cec90e228256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Creating volume 2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:23 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23b3329-b0d5-4ec4-b3e4-527217f37aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95759e4-07ac-4853-bead-d06467587b69', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:23 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 1073741824 Apr 14 03:51:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f704de-367b-4b5d-bc5b-08959b941208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:23 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:24 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Volume volume-a95759e4-07ac-4853-bead-d06467587b69 (a95759e4-07ac-4853-bead-d06467587b69): created successfully Apr 14 03:51:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f704de-367b-4b5d-bc5b-08959b941208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (fc013369-47ed-40c7-9df0-1dae1d4a34e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:24 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-248f0f30-08b3-4890-b675-4c7609bdfccc tempest-VolumesTestJSON-743857950 None] Created volume successfully. Apr 14 03:51:24 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 1073741824" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:24 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 Apr 14 03:51:24 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (ad390a1e-e5fa-417b-b650-869765f94562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:25 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0c5ccc-9983-4fe9-b3a8-d4faa990fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" returned: 0 in 0.534s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0c5ccc-9983-4fe9-b3a8-d4faa990fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-341754640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1497caa1-9e60-4d5b-83a1-5500e886cb58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:25Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1342e5ff-64e1-42ac-9394-69bda17a23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1342e5ff-64e1-42ac-9394-69bda17a23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5636694-f144-4499-937b-c7afc8754050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5636694-f144-4499-937b-c7afc8754050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1497caa1-9e60-4d5b-83a1-5500e886cb58', 'volume_name': 'volume-1497caa1-9e60-4d5b-83a1-5500e886cb58', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1896811-64d4-4532-91ab-d6dcbe6c27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1896811-64d4-4532-91ab-d6dcbe6c27ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3468b88-6f3e-4c66-9c0b-f5cb1240c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Volume 1497caa1-9e60-4d5b-83a1-5500e886cb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1497caa1-9e60-4d5b-83a1-5500e886cb58', 'volume_size': 1} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-341754640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1497caa1-9e60-4d5b-83a1-5500e886cb58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8e263f6c00064f54be8db2ee5320f14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:25Z,use_quota=True,user_id='ca6b933a27b24808a402f72680e4db9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Creating volume 1497caa1-9e60-4d5b-83a1-5500e886cb58 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b825f4c4-faac-41aa-b198-c88e31da97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dbc035-ddf6-403b-9479-295e00515291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:25 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 1073741824 Apr 14 03:51:25 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Volume volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 (2f8e3c29-e59b-4a82-9b69-bb51fd9540c5): created successfully Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dbc035-ddf6-403b-9479-295e00515291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Flow 'volume_create_manager' (02de0f8e-9885-425e-b59a-f6e524182a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-be980f5f-47c0-4185-bb07-288ef9306560 req-ebb3cadc-4c17-41d5-9823-313f81391830 tempest-VolumesSnapshotsTestJSON-379946438 None] Created volume successfully. Apr 14 03:51:25 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 1073741824" returned: 0 in 0.566s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:25 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 Apr 14 03:51:25 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:26 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58" returned: 0 in 0.565s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:DELETE=13,cinder:SELECT=109,cinder:UPDATE=158,cinder:INSERT=28 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=138,cinder:SELECT=135,cinder:INSERT=49,cinder:DELETE=13 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3468b88-6f3e-4c66-9c0b-f5cb1240c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1497caa1-9e60-4d5b-83a1-5500e886cb58', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a071c41-0892-423e-9a6f-4f642a331194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Creating offline snapshot bb40aa79-6e4d-4402-8dc7-bf579cda3f6b of volume 2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb7abc7-45c7-4364-9be2-4db46f094acb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Volume volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 (1497caa1-9e60-4d5b-83a1-5500e886cb58): created successfully Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a071c41-0892-423e-9a6f-4f642a331194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Flow 'volume_create_manager' (ad390a1e-e5fa-417b-b650-869765f94562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a20639b2-7411-4f2c-a462-4d6ecf451924 tempest-VolumesTestJSON-743857950 None] Created volume successfully. Apr 14 03:51:26 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 Apr 14 03:51:26 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:27 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" returned: 0 in 0.617s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:27 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b 1G Apr 14 03:51:27 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Flow 'volume_create_manager' (2175763c-56ba-4c67-a2c1-97db60394c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0891e8d7-e9ad-4191-942c-3d9761cc9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0891e8d7-e9ad-4191-942c-3d9761cc9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-272569126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23cb37e-b518-4d48-81c3-b1983cb292f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c808d23da534100aef82c25f6372d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:27Z,use_quota=True,user_id='47431289b3804c1dbb0a257da73488b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5395c884-de64-4c0b-b339-1cdb71a0fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5395c884-de64-4c0b-b339-1cdb71a0fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da1ff8-1bd0-4a46-a556-ef2b4babd8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da1ff8-1bd0-4a46-a556-ef2b4babd8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23cb37e-b518-4d48-81c3-b1983cb292f9', 'volume_name': 'volume-f23cb37e-b518-4d48-81c3-b1983cb292f9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def25c33-e17a-492d-9fa8-be0e92d491fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def25c33-e17a-492d-9fa8-be0e92d491fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa245d-0466-48a8-b0d2-c5f60217b86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume f23cb37e-b518-4d48-81c3-b1983cb292f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23cb37e-b518-4d48-81c3-b1983cb292f9', 'volume_size': 1} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:27 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b 1G" returned: 0 in 0.649s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:27 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b Apr 14 03:51:27 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-1497caa1-9e60-4d5b-83a1-5500e886cb58-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "cinder-1497caa1-9e60-4d5b-83a1-5500e886cb58-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-quobyte-1497caa1-9e60-4d5b-83a1-5500e886cb58" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-1497caa1-9e60-4d5b-83a1-5500e886cb58" acquired by "delete_volume" :: waited 0.022s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1722ab-6a3e-4fda-9561-08de08cfc0f0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:28 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 Apr 14 03:51:28 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:28 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" returned: 0 in 0.563s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:28 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b is being set with open permissions: ugo+rw Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:28 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b Apr 14 03:51:28 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:28 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58" returned: 0 in 0.665s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:28 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58 Apr 14 03:51:28 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:28 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:28 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info Apr 14 03:51:28 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:29 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1497caa1-9e60-4d5b-83a1-5500e886cb58" returned: 0 in 0.456s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-1497caa1-9e60-4d5b-83a1-5500e886cb58" released by "delete_volume" :: held 1.143s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Created reservations ['96d7b32e-de95-4e3d-9fd2-1e7727f00a39', '2f1cad8f-8b88-4190-9738-de26a4243490', '2471f7a1-d229-4b7f-8b8e-3e272333211e', 'a504d388-a0ba-4357-b672-236d22c2b939'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:29 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:29 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:29 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info" returned: 0 in 0.499s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:29 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info is being set with open permissions: ugo+rw Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:29 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info Apr 14 03:51:29 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:29 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.416s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Deleted volume successfully. Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7c6ff1a5-4802-4a62-aa2a-62412353b279 tempest-VolumesTestJSON-743857950 None] Lock "cinder-1497caa1-9e60-4d5b-83a1-5500e886cb58-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:29 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.info" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.421s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-272569126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23cb37e-b518-4d48-81c3-b1983cb292f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c808d23da534100aef82c25f6372d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:27Z,use_quota=True,user_id='47431289b3804c1dbb0a257da73488b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Creating volume f23cb37e-b518-4d48-81c3-b1983cb292f9 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:29 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:29 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 1073741824 Apr 14 03:51:29 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-da1819f1-9976-49bc-ba48-25eaefe75536 req-2b7fcd03-83a0-43d2-b668-68b1355a282e tempest-VolumesSnapshotsTestJSON-379946438 None] Create snapshot completed successfully Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-a95759e4-07ac-4853-bead-d06467587b69-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "cinder-a95759e4-07ac-4853-bead-d06467587b69-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-quobyte-a95759e4-07ac-4853-bead-d06467587b69" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-a95759e4-07ac-4853-bead-d06467587b69" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7f77bf-2e75-4634-acb2-282626fcfccc]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:30 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 Apr 14 03:51:30 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:30 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 1073741824" returned: 0 in 0.537s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:30 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 Apr 14 03:51:30 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:30 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69" returned: 0 in 0.621s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:30 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69 Apr 14 03:51:30 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:30 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9" returned: 0 in 0.566s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa245d-0466-48a8-b0d2-c5f60217b86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23cb37e-b518-4d48-81c3-b1983cb292f9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a656c5a-a1ed-4c2d-8b31-60ff0eec333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "cinder-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:31 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 (f23cb37e-b518-4d48-81c3-b1983cb292f9): created successfully Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a656c5a-a1ed-4c2d-8b31-60ff0eec333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Flow 'volume_create_manager' (2175763c-56ba-4c67-a2c1-97db60394c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:31 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-335f4bf2-4105-4bc2-8e9b-cef5d1d4a672 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Created volume successfully. Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "cinder-quobyte-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Deleting offline snapshot bb40aa79-6e4d-4402-8dc7-bf579cda3f6b of volume 2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] snapshot_file for this snap is: volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd18a11-3fcd-4cf0-ae8b-336ddb35f4cb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:31 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b Apr 14 03:51:31 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:31 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a95759e4-07ac-4853-bead-d06467587b69" returned: 0 in 0.537s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-a95759e4-07ac-4853-bead-d06467587b69" released by "delete_volume" :: held 1.196s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Created reservations ['121af701-e6f0-41d5-8202-9cf496dc12f6', '7ce569b9-737e-4cef-a16a-e7c07202f052', '56e37dea-dd0b-4b96-9219-c3c8344b1d01', '656f77d3-02cb-46f7-9f02-21587ff8321d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (5dfbb3ea-b1e6-45b3-8b81-b9c7664975f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012b69b5-e8d2-4840-8f90-21f96f2dee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012b69b5-e8d2-4840-8f90-21f96f2dee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1241060757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c13d156-1e22-48ef-a460-3ee426d4e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:31Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd4cd42-cb72-4bdc-94fa-dfedf76de8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd4cd42-cb72-4bdc-94fa-dfedf76de8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d4b4ca-8bbf-4783-ab22-837b36b2b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d4b4ca-8bbf-4783-ab22-837b36b2b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c13d156-1e22-48ef-a460-3ee426d4e4c7', 'volume_name': 'volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c683d17e-e8a3-4e74-97df-5bac3daa349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c683d17e-e8a3-4e74-97df-5bac3daa349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a83faac-a109-4ab5-b23d-cd9d95c10dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:31 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume 1c13d156-1e22-48ef-a460-3ee426d4e4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7', 'volume_size': 1} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1241060757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c13d156-1e22-48ef-a460-3ee426d4e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:31Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating volume 1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:31 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:31 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:31 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 1073741824 Apr 14 03:51:31 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" returned: 0 in 0.500s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:31 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:31 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9083cc4b-5af6-4db9-b731-1580c519d715]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:31 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 Apr 14 03:51:31 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "cinder-f23cb37e-b518-4d48-81c3-b1983cb292f9-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "cinder-f23cb37e-b518-4d48-81c3-b1983cb292f9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "cinder-quobyte-f23cb37e-b518-4d48-81c3-b1983cb292f9" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "cinder-quobyte-f23cb37e-b518-4d48-81c3-b1983cb292f9" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c4be6-5df8-4fe0-90d7-6289a9d063b1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:31 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 Apr 14 03:51:31 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Deleted volume successfully. Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ec642168-7922-49d1-a5d3-f7d58fcf6bf1 tempest-VolumesTestJSON-743857950 None] Lock "cinder-a95759e4-07ac-4853-bead-d06467587b69-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:32 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 1073741824" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 Apr 14 03:51:32 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" returned: 0 in 0.556s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b Apr 14 03:51:32 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-d4f91251-9b7d-4030-9dc8-794e167e2eb8-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:32 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "cinder-d4f91251-9b7d-4030-9dc8-794e167e2eb8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Acquiring lock "cinder-quobyte-d4f91251-9b7d-4030-9dc8-794e167e2eb8" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-d4f91251-9b7d-4030-9dc8-794e167e2eb8" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9749c21-d6ee-4d2d-b19f-a3eb8a409deb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9 Apr 14 03:51:32 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 Apr 14 03:51:32 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a83faac-a109-4ab5-b23d-cd9d95c10dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:32 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791ea579-3b9d-43ea-92a4-4414425a652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:32 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 (1c13d156-1e22-48ef-a460-3ee426d4e4c7): created successfully Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791ea579-3b9d-43ea-92a4-4414425a652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (5dfbb3ea-b1e6-45b3-8b81-b9c7664975f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-850857e4-4d96-4fc8-b5b3-6482c28a1275 tempest-VolumesSnapshotTestJSON-1950238867 None] Created volume successfully. Apr 14 03:51:32 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f23cb37e-b518-4d48-81c3-b1983cb292f9" returned: 0 in 0.458s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "cinder-quobyte-f23cb37e-b518-4d48-81c3-b1983cb292f9" released by "delete_volume" :: held 0.996s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Created reservations ['2f8dfac8-213f-4e52-841d-35c938b5a710', '50666a07-ab62-4953-ad0d-5cf09d35716d', 'bfbb497f-dd8e-4de3-a4b3-e9a65155adc1', '2e6c0ad9-b26e-4d47-915c-ad845278c2fa'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:32 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:32 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8" returned: 0 in 0.567s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:32 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8 Apr 14 03:51:32 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:33 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5.bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" returned: 0 in 0.448s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b" released by "_delete_snapshot" :: held 2.041s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" released by "delete_snapshot" :: held 2.056s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.quota [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Created reservations ['8f951940-4fee-4610-bf26-c54c0cdb98a1', '1321f4ba-9ce1-4e75-a874-217cee9b7a7c', '698f12c1-2752-4ef5-bb16-ad27a7b65464', '7a4fad81-f5a8-48cd-b729-59613e38dbb9'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Delete snapshot completed successfully. Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-b700f7ad-8798-4c28-8440-790686329066 req-61d6d9c8-83e2-4bec-b2dd-d49c7501ee73 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-bb40aa79-6e4d-4402-8dc7-bf579cda3f6b-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Flow 'volume_create_manager' (e0fccd05-ea54-4024-95fa-59ad7c1f0df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b19bb2-45bf-4a37-a9b9-4252b7e21fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b19bb2-45bf-4a37-a9b9-4252b7e21fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-652964332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe4eabd-09b5-4dab-ba46-57cd29be506d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c808d23da534100aef82c25f6372d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:33Z,use_quota=True,user_id='47431289b3804c1dbb0a257da73488b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f15d8-8214-4e3f-9565-abe538be26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f15d8-8214-4e3f-9565-abe538be26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75016e1b-a54f-4331-bce5-e7dd3b547e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75016e1b-a54f-4331-bce5-e7dd3b547e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe4eabd-09b5-4dab-ba46-57cd29be506d', 'volume_name': 'volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8b134c-7d4b-4705-8ec3-39bf84e4e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8b134c-7d4b-4705-8ec3-39bf84e4e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cc7b4-49a2-4810-9b4f-bb0e40cf6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:33 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume 6fe4eabd-09b5-4dab-ba46-57cd29be506d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d', 'volume_size': 1} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-652964332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe4eabd-09b5-4dab-ba46-57cd29be506d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c808d23da534100aef82c25f6372d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:33Z,use_quota=True,user_id='47431289b3804c1dbb0a257da73488b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Creating volume 6fe4eabd-09b5-4dab-ba46-57cd29be506d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:33 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:33 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d 1073741824 Apr 14 03:51:33 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:33 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Deleted volume successfully. Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8501d176-0a21-4cae-beab-f34453062d64 tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "cinder-f23cb37e-b518-4d48-81c3-b1983cb292f9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:33 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d4f91251-9b7d-4030-9dc8-794e167e2eb8" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "cinder-quobyte-d4f91251-9b7d-4030-9dc8-794e167e2eb8" released by "delete_volume" :: held 1.072s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Created reservations ['97187966-8cd4-4a3e-9191-165f303828a1', '7f9b2982-e1d2-4a99-a02e-1455e68e3fba', 'ce90da20-9870-4649-9a1d-4c98f1ff2c5d', 'ac5608ff-2dfa-477b-900c-dac51e4006b7'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:33 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:33 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:33 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d 1073741824" returned: 0 in 0.560s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:33 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d Apr 14 03:51:33 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:33 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.463s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Deleted volume successfully. Apr 14 03:51:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5ea20f70-e8dd-4f4b-91a4-22d7b682748a tempest-VolumesTestJSON-743857950 None] Lock "cinder-d4f91251-9b7d-4030-9dc8-794e167e2eb8-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "cinder-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:34 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d" returned: 0 in 0.450s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.560s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating offline snapshot b76db563-712e-44b4-88c2-cdcabdb3cfb4 of volume 1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf45298-d65f-4bd7-8ede-d3d2f235e24f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cc7b4-49a2-4810-9b4f-bb0e40cf6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d931f8-9e48-4c37-9c79-8b4a4d8d5a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" acquired by "delete_volume" :: waited 0.036s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:34 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Volume volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d (6fe4eabd-09b5-4dab-ba46-57cd29be506d): created successfully Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d931f8-9e48-4c37-9c79-8b4a4d8d5a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Flow 'volume_create_manager' (e0fccd05-ea54-4024-95fa-59ad7c1f0df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d90816f-47e0-4985-ae66-581bd31385c5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-691ca476-504f-40e2-bdbc-fc4a175692ae tempest-VolumeQuotasAdminTestJSON-1501131917 None] Created volume successfully. Apr 14 03:51:34 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 Apr 14 03:51:34 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:34 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 Apr 14 03:51:34 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:34 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7" returned: 0 in 0.542s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:34 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 1G Apr 14 03:51:34 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:34 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" returned: 0 in 0.520s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:34 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5 Apr 14 03:51:34 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:35 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-quobyte-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5" released by "delete_volume" :: held 1.060s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG cinder.quota [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Created reservations ['edd51d0f-31d6-4a90-806d-ec84a6d3e9d5', '32581e8b-ad81-4001-a8a5-03d319c9a561', 'c9e19efa-2710-4e3f-ac2d-d5494766a8c0', '8092003c-ee14-43ae-a047-5c3db92aec44'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:35 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 1G" returned: 0 in 0.618s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:35 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 Apr 14 03:51:35 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:35 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:35 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3ba04e8a-adcc-4091-803d-f8af2f819511 tempest-VolumeQuotasAdminTestJSON-1417412075 None] Transfer volume completed successfully. Apr 14 03:51:35 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:35 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 is being set with open permissions: ugo+rw Apr 14 03:51:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:36 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 Apr 14 03:51:36 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:36 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.manager [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Deleted volume successfully. Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [req-5f9c2455-0413-4975-8593-fc977370aa4c req-b2319235-09ba-455d-a481-be40aed96628 tempest-VolumesSnapshotsTestJSON-379946438 None] Lock "cinder-2f8e3c29-e59b-4a82-9b69-bb51fd9540c5-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:36 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4" returned: 0 in 0.449s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:36 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info Apr 14 03:51:36 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Acquiring lock "cinder-6fe4eabd-09b5-4dab-ba46-57cd29be506d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "cinder-6fe4eabd-09b5-4dab-ba46-57cd29be506d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Acquiring lock "cinder-quobyte-6fe4eabd-09b5-4dab-ba46-57cd29be506d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "cinder-quobyte-6fe4eabd-09b5-4dab-ba46-57cd29be506d" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14c519-0c96-4cb8-af5a-17a2246818ec]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:36 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d Apr 14 03:51:36 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8b6672fd-7819-4f1e-9599-02a407c7c056 tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-1684714765: creating Apr 14 03:51:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8b6672fd-7819-4f1e-9599-02a407c7c056 tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-1684714765: created successfully Apr 14 03:51:37 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8b6672fd-7819-4f1e-9599-02a407c7c056 tempest-GroupSnapshotsTest-824165161 None] Create group completed successfully. Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info" returned: 0 in 0.588s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:37 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info is being set with open permissions: ugo+rw Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:37 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info Apr 14 03:51:37 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:37 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d" returned: 0 in 0.591s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:37 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d Apr 14 03:51:37 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:37 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.info" returned: 0 in 0.423s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-fbfce3d3-b681-4e0f-8913-8feb933034f2 tempest-VolumesSnapshotTestJSON-1950238867 None] Create snapshot completed successfully Apr 14 03:51:37 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6fe4eabd-09b5-4dab-ba46-57cd29be506d" returned: 0 in 0.450s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "cinder-quobyte-6fe4eabd-09b5-4dab-ba46-57cd29be506d" released by "delete_volume" :: held 1.067s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Created reservations ['d5085ef6-51bf-4465-a5c0-09fc232cc8ae', 'db6f237c-294f-4089-9f18-3570f99aca1c', 'edf844f5-accb-4c66-93a8-6b2f18e6a537', 'a93e60b2-746f-42f1-8e92-ebac886dee3e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:37 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:37 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-b76db563-712e-44b4-88c2-cdcabdb3cfb4-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-b76db563-712e-44b4-88c2-cdcabdb3cfb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-b76db563-712e-44b4-88c2-cdcabdb3cfb4" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-b76db563-712e-44b4-88c2-cdcabdb3cfb4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Deleting offline snapshot b76db563-712e-44b4-88c2-cdcabdb3cfb4 of volume 1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] snapshot_file for this snap is: volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579ce88-c1d1-4baa-81f1-13c5439585f8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:38 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 Apr 14 03:51:38 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (a479e874-ffe0-49dc-a56b-fc67fe7c4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f814c1-d82c-4293-94b8-91f2ea7cb4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f814c1-d82c-4293-94b8-91f2ea7cb4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075567494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df3a284d-ea6c-4cd1-8253-5b9d8588262c,host='devstack@QuobyteHD#QuobyteHD',id=4270a690-4919-45a4-b3b9-d6471c360cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:38Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5967db44-7ace-4038-8f2f-f7d79f90ecd5),volume_type_id=5967db44-7ace-4038-8f2f-f7d79f90ecd5)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c076fc56-4162-4f43-9c20-d6a115e2b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c076fc56-4162-4f43-9c20-d6a115e2b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78768c1-3939-43a5-8b22-0c3f6400112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78768c1-3939-43a5-8b22-0c3f6400112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4270a690-4919-45a4-b3b9-d6471c360cf3', 'volume_name': 'volume-4270a690-4919-45a4-b3b9-d6471c360cf3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ab42cb-7b8d-4561-8144-c515eddb5e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ab42cb-7b8d-4561-8144-c515eddb5e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef43444f-2ee5-4721-8b88-8d7512113a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:38 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Volume 4270a690-4919-45a4-b3b9-d6471c360cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4270a690-4919-45a4-b3b9-d6471c360cf3', 'volume_size': 1} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df3a284d-ea6c-4cd1-8253-5b9d8588262c,created_at=2026-04-14T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075567494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df3a284d-ea6c-4cd1-8253-5b9d8588262c,host='devstack@QuobyteHD#QuobyteHD',id=4270a690-4919-45a4-b3b9-d6471c360cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:38Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5967db44-7ace-4038-8f2f-f7d79f90ecd5),volume_type_id=5967db44-7ace-4038-8f2f-f7d79f90ecd5)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Creating volume 4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:38 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:38 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.563s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:38 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 1073741824 Apr 14 03:51:38 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Deleted volume successfully. Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c4fc8f24-80a3-4fe2-be09-4d0cca3b09cd tempest-VolumeQuotasAdminTestJSON-1886742457 None] Lock "cinder-6fe4eabd-09b5-4dab-ba46-57cd29be506d-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:38 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4" returned: 0 in 0.663s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b1c53d-ca49-4bae-99c6-cd5ac6671f4b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:38 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 Apr 14 03:51:38 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:39 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 1073741824" returned: 0 in 0.617s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:39 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:51:39 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:39 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7" returned: 0 in 0.596s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:39 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 Apr 14 03:51:39 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:39 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.595s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef43444f-2ee5-4721-8b88-8d7512113a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4270a690-4919-45a4-b3b9-d6471c360cf3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca0a22f-7e13-41a1-9157-3f052b4c975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:39 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Volume volume-4270a690-4919-45a4-b3b9-d6471c360cf3 (4270a690-4919-45a4-b3b9-d6471c360cf3): created successfully Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca0a22f-7e13-41a1-9157-3f052b4c975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (a479e874-ffe0-49dc-a56b-fc67fe7c4497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecca50b9-521f-4eb0-8a92-d4a744971e77 tempest-GroupSnapshotsTest-824165161 None] Created volume successfully. Apr 14 03:51:40 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4" returned: 0 in 0.690s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:40 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4 Apr 14 03:51:40 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:40 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7.b76db563-712e-44b4-88c2-cdcabdb3cfb4" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-b76db563-712e-44b4-88c2-cdcabdb3cfb4" released by "_delete_snapshot" :: held 2.560s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" released by "delete_snapshot" :: held 2.583s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['4eb65ee6-97af-4803-998a-f17b1e241625', 'de6748b4-95a8-486d-8409-c3e545438e9b', 'c6fd526d-1b2b-4c10-bf9f-bcc179643f8e', '194a4ae2-ce7e-4578-9995-72213bec738f'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] GroupSnapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: creating. Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Group snapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: creating. {{(pid=82370) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Delete snapshot completed successfully. Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ecb9c2dd-f129-4730-889c-cae7122b7362 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-b76db563-712e-44b4-88c2-cdcabdb3cfb4-delete_snapshot" released by "delete_snapshot" :: held 2.785s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Creating offline snapshot 33b4f5d1-678e-4e07-b2dd-3c80c679e972 of volume 4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd98b18-8bc1-4f97-ba3f-f1886ba73a92]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:40 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:51:40 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:41 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.673s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:41 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 1G Apr 14 03:51:41 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (21ab2355-f128-4e31-9b8f-0a40d099eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d2165a-9e13-4186-8269-48bcba2d7307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d2165a-9e13-4186-8269-48bcba2d7307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1705251088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38b0f13-0863-4b0b-8cab-455c90944d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:41Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac8d29a-d1f6-4afb-ad56-4c8e7161b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac8d29a-d1f6-4afb-ad56-4c8e7161b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ced1b6f-c225-4f5f-bd66-dda9858efeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ced1b6f-c225-4f5f-bd66-dda9858efeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38b0f13-0863-4b0b-8cab-455c90944d2f', 'volume_name': 'volume-d38b0f13-0863-4b0b-8cab-455c90944d2f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b43c42-e38f-4790-a986-75ad6f8ea957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b43c42-e38f-4790-a986-75ad6f8ea957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e99071c-cda9-409f-b264-766befb8622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:41 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Volume d38b0f13-0863-4b0b-8cab-455c90944d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38b0f13-0863-4b0b-8cab-455c90944d2f', 'volume_size': 1} Apr 14 03:51:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:42 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 1G" returned: 0 in 0.579s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4270a690-4919-45a4-b3b9-d6471c360cf3 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:42 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4270a690-4919-45a4-b3b9-d6471c360cf3 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:51:42 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:42 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4270a690-4919-45a4-b3b9-d6471c360cf3 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:42 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:51:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:42 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:51:42 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:43 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.433s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:43 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info Apr 14 03:51:43 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:43 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info" returned: 0 in 0.473s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:43 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:51:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:43 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info Apr 14 03:51:43 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:44 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.info" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1705251088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38b0f13-0863-4b0b-8cab-455c90944d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:41Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Creating volume d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:44 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:44 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f 1073741824 Apr 14 03:51:44 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-81aa08af-3e96-490f-986b-d62c373051af tempest-GroupSnapshotsTest-824165161 None] group_snapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: created successfully Apr 14 03:51:44 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f 1073741824" returned: 0 in 0.565s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:44 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:51:44 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:45 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.544s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e99071c-cda9-409f-b264-766befb8622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38b0f13-0863-4b0b-8cab-455c90944d2f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae49bba-f7a9-48fd-b81a-d6071370261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Volume volume-d38b0f13-0863-4b0b-8cab-455c90944d2f (d38b0f13-0863-4b0b-8cab-455c90944d2f): created successfully Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae49bba-f7a9-48fd-b81a-d6071370261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (21ab2355-f128-4e31-9b8f-0a40d099eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:45 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-fcc8ad20-a6b2-41f8-9541-40af6844a89c tempest-VolumesSnapshotTestJSON-1950238867 None] Created volume successfully. Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating offline snapshot 550d17c4-2382-4791-9631-40ed21bd059b of volume d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d1c22b-b69b-47a1-8be3-e9c46b8311bd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:46 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:51:46 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:46 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.707s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:46 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b 1G Apr 14 03:51:46 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:47 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b 1G" returned: 0 in 0.601s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38b0f13-0863-4b0b-8cab-455c90944d2f -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:47 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38b0f13-0863-4b0b-8cab-455c90944d2f -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:51:47 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:47 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38b0f13-0863-4b0b-8cab-455c90944d2f -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:47 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b is being set with open permissions: ugo+rw Apr 14 03:51:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:47 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:51:47 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:48 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.474s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:48 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info Apr 14 03:51:48 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:48 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info" returned: 0 in 0.506s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:48 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info is being set with open permissions: ugo+rw Apr 14 03:51:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:48 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info Apr 14 03:51:48 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:49 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.info" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.242s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972-30c091fa-288f-4af2-8d5b-5b3eb7492005" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972-30c091fa-288f-4af2-8d5b-5b3eb7492005" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Creating volume 30c091fa-288f-4af2-8d5b-5b3eb7492005 from snapshot 33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d2f32f67-cac5-45e1-88f2-a109c9c20692 tempest-VolumesSnapshotTestJSON-1950238867 None] Create snapshot completed successfully Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] snapshot: 33b4f5d1-678e-4e07-b2dd-3c80c679e972, volume: 30c091fa-288f-4af2-8d5b-5b3eb7492005, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0d474a-5c12-41d3-aec8-5750f4a90ca0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:49 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:51:49 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:49 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.586s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4270a690-4919-45a4-b3b9-d6471c360cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[be127629-66d4-43be-9e2e-c283ee4706bd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:50 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:51:50 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (6e57ccfc-4d6e-4016-90fe-05e2ef799988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13366cfa-435e-44f3-8ebf-15ff4f681988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13366cfa-435e-44f3-8ebf-15ff4f681988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-102147457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd617ba8-bd43-481b-b67f-8b69e83ad06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=550d17c4-2382-4791-9631-40ed21bd059b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:50Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d77938-c7a5-4aae-b24c-35a302e0250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d77938-c7a5-4aae-b24c-35a302e0250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51443915-e547-4bdf-a22b-9fce14b6d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51443915-e547-4bdf-a22b-9fce14b6d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd617ba8-bd43-481b-b67f-8b69e83ad06c', 'volume_name': 'volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c', 'volume_size': 2, 'snapshot_id': '550d17c4-2382-4791-9631-40ed21bd059b'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e32f9f-0ccd-4092-91df-7439ce9cda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e32f9f-0ccd-4092-91df-7439ce9cda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6de684d-6f1b-4e6d-a682-50b2ac211996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Volume cd617ba8-bd43-481b-b67f-8b69e83ad06c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c', 'volume_size': 2, 'snapshot_id': '550d17c4-2382-4791-9631-40ed21bd059b'} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:50 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.735s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:50 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 Apr 14 03:51:50 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:50 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (ad78610e-fd8d-49bf-8963-452dcae0827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d5a47-4f86-4922-a6de-3e3168c4fc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d5a47-4f86-4922-a6de-3e3168c4fc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-377288415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d5deef-a269-4dd9-9156-7b17812eb772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:51Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd9d555-4391-4359-a1df-7460bf90cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd9d555-4391-4359-a1df-7460bf90cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8f2283-6987-49e0-a2fa-643dadfd5fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8f2283-6987-49e0-a2fa-643dadfd5fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d5deef-a269-4dd9-9156-7b17812eb772', 'volume_name': 'volume-d5d5deef-a269-4dd9-9156-7b17812eb772', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2752986b-2b29-401c-a294-fb3b2849d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2752986b-2b29-401c-a294-fb3b2849d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7e56e-8ab7-40fe-a9c3-33b257ab2285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Volume d5d5deef-a269-4dd9-9156-7b17812eb772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d5deef-a269-4dd9-9156-7b17812eb772', 'volume_size': 1} Apr 14 03:51:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:52 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005" returned: 0 in 2.085s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:52 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e2b34-ffe7-4f49-bc63-7686f596f7ef]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:52 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:51:52 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:53 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.606s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:51:53 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Converted 1024.00 MB image at 490.97 MB/s Apr 14 03:51:53 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:53 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 Apr 14 03:51:53 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:53 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005" returned: 0 in 0.432s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" released by "_copy_volume_from_snapshot" :: held 4.514s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972-30c091fa-288f-4af2-8d5b-5b3eb7492005" released by "_create_volume_from_snapshot" :: held 4.537s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.559s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.239s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b-cd617ba8-bd43-481b-b67f-8b69e83ad06c" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b-cd617ba8-bd43-481b-b67f-8b69e83ad06c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Creating volume cd617ba8-bd43-481b-b67f-8b69e83ad06c from snapshot 550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] snapshot: 550d17c4-2382-4791-9631-40ed21bd059b, volume: cd617ba8-bd43-481b-b67f-8b69e83ad06c, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f316c26a-4af4-47fa-bb76-ffd675f34628]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:53 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-17a28a74-d5e9-4c90-9806-291eea5867c8 tempest-GroupSnapshotsTest-824165161 None] Create group from source-snapshot-411331b2-fe1e-4b56-8fb0-a3545fa70d9c completed successfully. Apr 14 03:51:53 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:51:53 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:54 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d38b0f13-0863-4b0b-8cab-455c90944d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d10bae2-7a19-444a-a763-f4af418cb00d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:54 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:51:54 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:54 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.497s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:51:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:54 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c Apr 14 03:51:54 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f32cf4-f4e7-4a02-a803-c93909f6610b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:55 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 Apr 14 03:51:55 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:55 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005" returned: 0 in 0.619s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:55 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005 Apr 14 03:51:55 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:57 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-30c091fa-288f-4af2-8d5b-5b3eb7492005" returned: 0 in 1.517s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-30c091fa-288f-4af2-8d5b-5b3eb7492005" released by "delete_volume" :: held 2.159s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:57 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c" returned: 0 in 2.398s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ea27f-9a44-4986-b23d-010438543d60]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['d023efdf-4ac2-43b8-84f8-ee0170ee8c81'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:57 devstack cinder-volume[82370]: WARNING cinder.quota [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-818028044 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-818028044, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:51:57 devstack cinder-volume[82370]: WARNING cinder.quota [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-818028044 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-818028044, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['adbb8140-9945-4420-a4cf-fdb09c4302f2', '861a947e-65d6-41db-8a19-56409ac628b1', '1b8c63bc-a1c2-41ee-8735-cfb187392059', '9ac6ff85-c2d5-4ea9-89fe-7fc9a31adf44'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:51:57 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:51:57 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:57 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:57 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:57 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f3f9dde1-7efc-4661-a6b2-a206e473f5c4 tempest-GroupSnapshotsTest-824165161 None] Delete group completed successfully. Apr 14 03:51:57 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.684s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:51:57 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Converted 1024.00 MB image at 426.75 MB/s Apr 14 03:51:57 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c is being set with open permissions: ugo+rw Apr 14 03:51:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:57 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c Apr 14 03:51:58 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:58 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c" returned: 0 in 0.399s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" released by "_copy_volume_from_snapshot" :: held 4.536s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b-cd617ba8-bd43-481b-b67f-8b69e83ad06c" released by "_create_volume_from_snapshot" :: held 4.556s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.571s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.323s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-377288415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d5deef-a269-4dd9-9156-7b17812eb772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:51Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Creating volume d5d5deef-a269-4dd9-9156-7b17812eb772 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:58 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:58 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 1073741824 Apr 14 03:51:58 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6de684d-6f1b-4e6d-a682-50b2ac211996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c', 'volume_size': 2, 'snapshot_id': '550d17c4-2382-4791-9631-40ed21bd059b'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec5b2d-8869-4a4d-b202-27f9f11b9c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Flow 'volume_create_manager' (df3e719f-3c96-49b6-aa18-632518f0a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbade3ea-0f00-486d-a25d-9f76e5a38605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbade3ea-0f00-486d-a25d-9f76e5a38605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-66177366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61f8f82-9a5c-4a6f-9b88-f05926bae306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1df2cd974354242b1ed7693d7a1a069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:58Z,use_quota=True,user_id='b679b4892fc34fb290bbc25a107c186e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a526da38-59b9-4820-9622-03ca1e081450),volume_type_id=a526da38-59b9-4820-9622-03ca1e081450)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ea571a-78e8-4863-b08a-7b3ad2e94125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ea571a-78e8-4863-b08a-7b3ad2e94125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508fbd7-56a1-4bbd-a706-f65667e6bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508fbd7-56a1-4bbd-a706-f65667e6bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61f8f82-9a5c-4a6f-9b88-f05926bae306', 'volume_name': 'volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67996b35-8af3-4fdc-944f-174c40065874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67996b35-8af3-4fdc-944f-174c40065874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2c3626-9d27-454d-9c24-158cd29d39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:58 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Volume b61f8f82-9a5c-4a6f-9b88-f05926bae306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306', 'volume_size': 1} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: deleting Apr 14 03:51:58 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Volume volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c (cd617ba8-bd43-481b-b67f-8b69e83ad06c): created successfully Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec5b2d-8869-4a4d-b202-27f9f11b9c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (6e57ccfc-4d6e-4016-90fe-05e2ef799988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-17089b9d-b4a5-4fe2-832f-0cb1de947e3b tempest-VolumesSnapshotTestJSON-1950238867 None] Created volume successfully. Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: deleting {{(pid=82370) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Deleting offline snapshot 33b4f5d1-678e-4e07-b2dd-3c80c679e972 of volume 4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] snapshot_file for this snap is: volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[462da5d9-f082-46dc-a8b7-9f974e794869]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:58 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:51:58 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:58 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:51:58 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:58 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 1073741824" returned: 0 in 0.508s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:58 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 Apr 14 03:51:58 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:59 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4270a690-4919-45a4-b3b9-d6471c360cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016a6b0-3234-4147-a4c6-041643a8a51e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:51:59 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-cd617ba8-bd43-481b-b67f-8b69e83ad06c-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-cd617ba8-bd43-481b-b67f-8b69e83ad06c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:59 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:59 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-66177366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61f8f82-9a5c-4a6f-9b88-f05926bae306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1df2cd974354242b1ed7693d7a1a069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:51:58Z,use_quota=True,user_id='b679b4892fc34fb290bbc25a107c186e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a526da38-59b9-4820-9622-03ca1e081450),volume_type_id=a526da38-59b9-4820-9622-03ca1e081450)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Creating volume b61f8f82-9a5c-4a6f-9b88-f05926bae306 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:51:59 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 1073741824 Apr 14 03:51:59 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7e56e-8ab7-40fe-a9c3-33b257ab2285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d5deef-a269-4dd9-9156-7b17812eb772', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72ff8e4-04be-4ff5-8802-5ff0a5c0e96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:51:59 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Volume volume-d5d5deef-a269-4dd9-9156-7b17812eb772 (d5d5deef-a269-4dd9-9156-7b17812eb772): created successfully Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72ff8e4-04be-4ff5-8802-5ff0a5c0e96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (ad78610e-fd8d-49bf-8963-452dcae0827d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" acquired by "delete_volume" :: waited 0.048s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:51:59 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-231ab302-24c8-479e-85f2-1d6f2d1c0bf3 tempest-VolumesListAdminTestJSON-875583500 None] Created volume successfully. Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[885509d2-ce27-4f2e-b90e-8a9dbc3597e1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c Apr 14 03:51:59 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:59 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.581s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:51:59 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (7b23cc49-1bda-4755-b976-db13c7953286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:51:59 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56960dc9-db42-4345-a0b1-71d1a3f82463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 1073741824" returned: 0 in 0.559s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56960dc9-db42-4345-a0b1-71d1a3f82463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585497733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4de1c7-8949-4c14-9da3-57f1e259f0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:00Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc97515-09a0-4427-a3bc-a8c8f3421fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc97515-09a0-4427-a3bc-a8c8f3421fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b6a35-acd2-4ef6-b601-5a36aaa456f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b6a35-acd2-4ef6-b601-5a36aaa456f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4de1c7-8949-4c14-9da3-57f1e259f0e3', 'volume_name': 'volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2950cb-8c42-4a7f-8856-4049d65911b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2950cb-8c42-4a7f-8856-4049d65911b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33dbd70-9f0c-4380-aefe-e3e1de3b4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:51:59 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Volume 9a4de1c7-8949-4c14-9da3-57f1e259f0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3', 'volume_size': 1} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c" returned: 0 in 0.527s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:51:59 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c Apr 14 03:51:59 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 Apr 14 03:52:00 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.544s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:00 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972 Apr 14 03:52:00 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:00 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306" returned: 0 in 0.408s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585497733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4de1c7-8949-4c14-9da3-57f1e259f0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:00Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Creating volume 9a4de1c7-8949-4c14-9da3-57f1e259f0e3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:00 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2c3626-9d27-454d-9c24-158cd29d39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55be61a7-e858-419b-876c-3cad976e4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:00 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 1073741824 Apr 14 03:52:00 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd617ba8-bd43-481b-b67f-8b69e83ad06c" returned: 0 in 0.457s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-cd617ba8-bd43-481b-b67f-8b69e83ad06c" released by "delete_volume" :: held 1.008s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Volume volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 (b61f8f82-9a5c-4a6f-9b88-f05926bae306): created successfully Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55be61a7-e858-419b-876c-3cad976e4231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Flow 'volume_create_manager' (df3e719f-3c96-49b6-aa18-632518f0a355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-834c55eb-ace6-4cdc-9f41-8b73a0266f84 tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Created volume successfully. Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['0937ea13-36d2-49b0-82ee-e22848cdab41', '2f82de16-9a77-4c18-845e-0bc36c8c454d', '450c2075-854d-4532-95f3-d9d0075ede08', '85186ade-7922-46fd-8e62-161a9bb2f00c'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:00 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:00 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3.33b4f5d1-678e-4e07-b2dd-3c80c679e972" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-33b4f5d1-678e-4e07-b2dd-3c80c679e972" released by "_delete_snapshot" :: held 2.084s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" released by "delete_snapshot" :: held 2.096s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:00 devstack cinder-volume[82370]: WARNING cinder.quota [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-818028044 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-818028044, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['6f00b51e-1bee-49c5-a876-10fdbf07008b', '5677a115-a016-41f3-b454-a82aabfc886e', '95831755-4b3e-4735-b896-aff0933d4d54', '453e20fc-9880-4299-b243-b179bce77e42'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b8f3212e-08de-4d6a-a79a-84c1d0bc7138 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 411331b2-fe1e-4b56-8fb0-a3545fa70d9c: deleted successfully Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:00 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:00 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:00 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 1073741824" returned: 0 in 0.568s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:01 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 Apr 14 03:52:01 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:01 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Deleted volume successfully. Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-460c0e3c-e000-481c-8d5f-4f821a438e69 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-cd617ba8-bd43-481b-b67f-8b69e83ad06c-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:01 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.429s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c86ca2a3-6025-4703-8b2f-8359a01f8aec tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Retype volume completed successfully. Apr 14 03:52:01 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33dbd70-9f0c-4380-aefe-e3e1de3b4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef5f962-fa44-4306-a836-533e4da11eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Volume volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 (9a4de1c7-8949-4c14-9da3-57f1e259f0e3): created successfully Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef5f962-fa44-4306-a836-533e4da11eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (7b23cc49-1bda-4755-b976-db13c7953286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-550d17c4-2382-4791-9631-40ed21bd059b-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-986961fe-6629-4f8c-b29e-b76d5bba25ff tempest-VolumesListAdminTestJSON-875583500 None] Created volume successfully. Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-550d17c4-2382-4791-9631-40ed21bd059b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Deleting offline snapshot 550d17c4-2382-4791-9631-40ed21bd059b of volume d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] snapshot_file for this snap is: volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5099960-f7da-4842-9641-08ac17dfba7f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:01 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:52:01 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d70f76-4cb8-4eee-8eb0-db27e4302daa]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:01 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:52:01 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d38b0f13-0863-4b0b-8cab-455c90944d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a3a1d5-cef7-40d8-9b77-7dcc828176b7]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:52:02 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "cinder-b61f8f82-9a5c-4a6f-9b88-f05926bae306-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (902f1f19-8022-4449-a04c-b5385dd0e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fef737e-f7eb-40f3-9fae-352f3e104829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fef737e-f7eb-40f3-9fae-352f3e104829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-619975674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96410fe0-2bea-4e75-9ba6-a3f2206e4635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:02Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537c4fd5-f4f1-41b6-a8f6-2459e1b424de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537c4fd5-f4f1-41b6-a8f6-2459e1b424de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ffb144-f1d1-4d47-9430-c95883603c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ffb144-f1d1-4d47-9430-c95883603c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96410fe0-2bea-4e75-9ba6-a3f2206e4635', 'volume_name': 'volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341cacd6-5d7a-49b5-ada4-74bc45f559c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341cacd6-5d7a-49b5-ada4-74bc45f559c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102c32f3-495f-4f80-ae55-77c08163c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:02 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Volume 96410fe0-2bea-4e75-9ba6-a3f2206e4635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635', 'volume_size': 1} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-619975674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96410fe0-2bea-4e75-9ba6-a3f2206e4635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad295e62537a4bd0992233dfc0b08b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:02Z,use_quota=True,user_id='24607879ea6342859bda2775d7d96e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Creating volume 96410fe0-2bea-4e75-9ba6-a3f2206e4635 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:02 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "cinder-b61f8f82-9a5c-4a6f-9b88-f05926bae306-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:02 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 1073741824 Apr 14 03:52:02 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "cinder-quobyte-b61f8f82-9a5c-4a6f-9b88-f05926bae306" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "cinder-quobyte-b61f8f82-9a5c-4a6f-9b88-f05926bae306" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0fb4ab-737b-4124-ba7d-697f2660a6e3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.587s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 Apr 14 03:52:02 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3 Apr 14 03:52:02 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.554s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:52:02 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 1073741824" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:02 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306 Apr 14 03:52:02 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4270a690-4919-45a4-b3b9-d6471c360cf3" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:02 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 Apr 14 03:52:02 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-4270a690-4919-45a4-b3b9-d6471c360cf3" released by "delete_volume" :: held 1.114s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['992efdf3-44b0-4541-b41c-1d5ea7c75876'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:03 devstack cinder-volume[82370]: WARNING cinder.db.sqlalchemy.api [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-818028044'] Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['9acc3379-5e22-429f-8cc4-8743aacbb56a', '9d0524d5-7002-41d8-ae01-8ffef197d04c', 'c880eb62-1090-42b4-88d0-3f0378dda0b7', '40507ac6-f99a-46d8-a5ea-e19747bf4f98'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:03 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.508s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:03 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:03 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:03 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b Apr 14 03:52:03 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:03 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b61f8f82-9a5c-4a6f-9b88-f05926bae306" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "cinder-quobyte-b61f8f82-9a5c-4a6f-9b88-f05926bae306" released by "delete_volume" :: held 1.026s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:03 devstack cinder-volume[82370]: WARNING cinder.quota [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:03 devstack cinder-volume[82370]: WARNING cinder.quota [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Created reservations ['22f30b11-0dcf-4df9-859c-2ccea43f13ed', '2b7e32a8-a62f-4212-a85a-5b7df98e146b', 'd213af76-fa84-4425-9c31-abf32b932244', '84268f85-268c-4324-9fc9-4583e1878e4d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:03 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635" returned: 0 in 0.598s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102c32f3-495f-4f80-ae55-77c08163c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540ad79-96a0-40f8-9e39-98bc9c6201be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:03 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Volume volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 (96410fe0-2bea-4e75-9ba6-a3f2206e4635): created successfully Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540ad79-96a0-40f8-9e39-98bc9c6201be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Flow 'volume_create_manager' (902f1f19-8022-4449-a04c-b5385dd0e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5cee3c5f-be7a-4d35-aeec-98a6e5ade7a3 tempest-VolumesListAdminTestJSON-875583500 None] Created volume successfully. Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:03 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.442s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:03 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:03 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f78f0e7f-99ab-4566-80ee-59e9a17c6c29 tempest-GroupSnapshotsTest-824165161 None] Delete group completed successfully. Apr 14 03:52:03 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f.550d17c4-2382-4791-9631-40ed21bd059b" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-550d17c4-2382-4791-9631-40ed21bd059b" released by "_delete_snapshot" :: held 2.120s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" released by "delete_snapshot" :: held 2.130s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['1e95c55b-e605-428f-954e-5eb8115ec56d', '35485736-c914-42de-9901-ef04d5ba87af', '1e2ae153-2754-4239-aaec-487f46a25fd8', '9f6db500-ad10-4c3e-bf6c-f35e26aee555'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Delete snapshot completed successfully. Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-67d1ea24-1b61-4935-a2e2-0573c780bcde tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-550d17c4-2382-4791-9631-40ed21bd059b-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:03 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Deleted volume successfully. Apr 14 03:52:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6a779e18-8b0b-48f0-8b49-79d033d7609a tempest-VolumeRetypeWithoutMigrationTest-1626292092 None] Lock "cinder-b61f8f82-9a5c-4a6f-9b88-f05926bae306-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d9a58a92-2ea5-461d-b286-39634cca0f3c tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-1674830732: creating Apr 14 03:52:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d9a58a92-2ea5-461d-b286-39634cca0f3c tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-1674830732: created successfully Apr 14 03:52:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d9a58a92-2ea5-461d-b286-39634cca0f3c tempest-GroupSnapshotsTest-824165161 None] Create group completed successfully. Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-d38b0f13-0863-4b0b-8cab-455c90944d2f-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-d38b0f13-0863-4b0b-8cab-455c90944d2f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966ffff-9c75-4386-98ab-92e97d872c8d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Flow 'volume_create_manager' (24dc4c6d-1405-4650-8362-3a4ed3cb6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6928d-1201-4cf5-8afa-7bf334ceeec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6928d-1201-4cf5-8afa-7bf334ceeec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884f269330ff49ffaa4c4980342a933f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:05Z,use_quota=True,user_id='51d2c71f94ab4a59bca0ca2ab16699df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:04 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:52:04 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0f412f-9063-4019-bfb8-8bc48b43c27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0f412f-9063-4019-bfb8-8bc48b43c27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21524ec-cffb-41ba-a978-b7e441af6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21524ec-cffb-41ba-a978-b7e441af6e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5', 'volume_name': 'volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91c0b6-0ba2-4e1d-b944-1ee02f62f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91c0b6-0ba2-4e1d-b944-1ee02f62f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9cb7b1-1e86-452f-a6e5-b26d4f16af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:04 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Volume f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5', 'volume_size': 1} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884f269330ff49ffaa4c4980342a933f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:05Z,use_quota=True,user_id='51d2c71f94ab4a59bca0ca2ab16699df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Creating volume f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:04 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:04 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 1073741824 Apr 14 03:52:04 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:05 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:05 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f Apr 14 03:52:05 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:05 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 1073741824" returned: 0 in 0.548s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:05 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 Apr 14 03:52:05 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (d4f48d56-6c89-47b5-b47b-2ee5fe57df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3cbfaf-605a-4736-b332-45785512cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3cbfaf-605a-4736-b332-45785512cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23764795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,host='devstack@QuobyteHD#QuobyteHD',id=9e431329-5443-47ac-9302-f95f672be397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:06Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0fa64-28c3-4f83-8225-4d0bb52ff75d),volume_type_id=4fc0fa64-28c3-4f83-8225-4d0bb52ff75d)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e3a241-e11d-42c0-8a4d-34129283a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e3a241-e11d-42c0-8a4d-34129283a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612a44da-fe70-4424-a647-9e6644a57df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612a44da-fe70-4424-a647-9e6644a57df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e431329-5443-47ac-9302-f95f672be397', 'volume_name': 'volume-9e431329-5443-47ac-9302-f95f672be397', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5682b88f-7dd1-45d1-bf61-5128d0f2a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5682b88f-7dd1-45d1-bf61-5128d0f2a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4b452-bebd-4d77-80d6-3766cfac495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:05 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Volume 9e431329-5443-47ac-9302-f95f672be397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e431329-5443-47ac-9302-f95f672be397', 'volume_size': 1} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:05 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d38b0f13-0863-4b0b-8cab-455c90944d2f" returned: 0 in 0.596s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-d38b0f13-0863-4b0b-8cab-455c90944d2f" released by "delete_volume" :: held 1.165s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:05 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['2091ced5-c5b0-42c8-93c7-7a3e00d2f2c3', '36dbab54-1f9f-4719-9b4b-073ee899efb3', '798e0a5a-ed55-4a6e-b4a5-e908a7aa9113', '8b4f0e58-73c6-4829-8fb9-6b96057621dd'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:06 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:06 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:06 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" returned: 0 in 0.572s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,created_at=2026-04-14T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23764795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,host='devstack@QuobyteHD#QuobyteHD',id=9e431329-5443-47ac-9302-f95f672be397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:06Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0fa64-28c3-4f83-8225-4d0bb52ff75d),volume_type_id=4fc0fa64-28c3-4f83-8225-4d0bb52ff75d)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Creating volume 9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:06 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9cb7b1-1e86-452f-a6e5-b26d4f16af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:06 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 1073741824 Apr 14 03:52:06 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32de12b7-525f-4dd3-b07f-194159e73f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:06 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Volume volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 (f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5): created successfully Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32de12b7-525f-4dd3-b07f-194159e73f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Flow 'volume_create_manager' (24dc4c6d-1405-4650-8362-3a4ed3cb6122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7b030c48-9da5-46fc-839d-7e4131e4f869 tempest-VolumesListAdminTestJSON-1382357458 None] Created volume successfully. Apr 14 03:52:06 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Deleted volume successfully. Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1655abe1-c585-4b7e-9b46-6f5607533239 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-d38b0f13-0863-4b0b-8cab-455c90944d2f-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:06 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 1073741824" returned: 0 in 0.602s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:06 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 Apr 14 03:52:06 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Acquiring lock "cinder-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "cinder-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Acquiring lock "cinder-quobyte-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "cinder-quobyte-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041d7ca-696f-43df-b780-96e18c6b566a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-96410fe0-2bea-4e75-9ba6-a3f2206e4635-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (1936bc52-053d-4d6c-bc40-875868ee43fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a67d03-7cd1-4165-8455-840e99c90569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-96410fe0-2bea-4e75-9ba6-a3f2206e4635-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:07 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 Apr 14 03:52:07 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397" returned: 0 in 0.602s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-quobyte-96410fe0-2bea-4e75-9ba6-a3f2206e4635" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a67d03-7cd1-4165-8455-840e99c90569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605507426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8909b40a-66ce-4b76-b02b-031d5cc7e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:07Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578285fd-1ca2-4f28-9d35-16c1a2d36e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578285fd-1ca2-4f28-9d35-16c1a2d36e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4209d7f-59c1-4677-b3d9-67655685851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4209d7f-59c1-4677-b3d9-67655685851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8909b40a-66ce-4b76-b02b-031d5cc7e859', 'volume_name': 'volume-8909b40a-66ce-4b76-b02b-031d5cc7e859', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85531e01-bdf4-4ace-9ea6-4cc41e23ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85531e01-bdf4-4ace-9ea6-4cc41e23ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a677e-773b-4bd9-94db-c71c9238c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume 8909b40a-66ce-4b76-b02b-031d5cc7e859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8909b40a-66ce-4b76-b02b-031d5cc7e859', 'volume_size': 1} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605507426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8909b40a-66ce-4b76-b02b-031d5cc7e859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:07Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating volume 8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:07 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4b452-bebd-4d77-80d6-3766cfac495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e431329-5443-47ac-9302-f95f672be397', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4e53d-c000-4f77-8fc4-575db9e15370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:07 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 1073741824 Apr 14 03:52:07 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Volume volume-9e431329-5443-47ac-9302-f95f672be397 (9e431329-5443-47ac-9302-f95f672be397): created successfully Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4e53d-c000-4f77-8fc4-575db9e15370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (d4f48d56-6c89-47b5-b47b-2ee5fe57df85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-96410fe0-2bea-4e75-9ba6-a3f2206e4635" acquired by "delete_volume" :: waited 0.092s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:07 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f12333f6-4c85-42cb-ba67-4f3eb5c9318d tempest-GroupSnapshotsTest-824165161 None] Created volume successfully. Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a9035-b232-42a0-b599-d014ebe2be56]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 Apr 14 03:52:07 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:07 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" returned: 0 in 0.610s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5 Apr 14 03:52:07 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:07 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 1073741824" returned: 0 in 0.616s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:07 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635" returned: 0 in 0.566s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:07 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635 Apr 14 03:52:07 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:08 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:08 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (06c4cd42-35cf-41b9-bd3b-b996eaeb8b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a2204f-c6a8-453c-af69-91d1e08fab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a2204f-c6a8-453c-af69-91d1e08fab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462445815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,host='devstack@QuobyteHD#QuobyteHD',id=9d6577dc-3da2-4843-aaa5-396bd6bf6178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:08Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0fa64-28c3-4f83-8225-4d0bb52ff75d),volume_type_id=4fc0fa64-28c3-4f83-8225-4d0bb52ff75d)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e6bfe8-1f90-491b-83b6-89dfdfbd3a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e6bfe8-1f90-491b-83b6-89dfdfbd3a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2652c673-98b5-4acb-9114-658b2372df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2652c673-98b5-4acb-9114-658b2372df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6577dc-3da2-4843-aaa5-396bd6bf6178', 'volume_name': 'volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4b422-8b8d-4fb4-a557-6da343e2eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb4b422-8b8d-4fb4-a557-6da343e2eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963d0692-43b3-458c-8969-427b456d44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Volume 9d6577dc-3da2-4843-aaa5-396bd6bf6178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178', 'volume_size': 1} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:08 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" returned: 0 in 0.710s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "cinder-quobyte-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5" released by "delete_volume" :: held 1.344s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Created reservations ['7d9fb9a1-f76a-44fe-8e7c-2ec932cb5b74', 'e0523615-0541-4682-84e3-a06318ca028f', '59b1867e-299b-4ad8-83cf-31d799ce9e1c', '92cd8462-12da-4551-8201-8a6a80209345'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:08 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:08 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:08 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-96410fe0-2bea-4e75-9ba6-a3f2206e4635" returned: 0 in 0.619s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-96410fe0-2bea-4e75-9ba6-a3f2206e4635" released by "delete_volume" :: held 1.211s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Created reservations ['15e7efb3-3b5c-41ac-af39-a29848f7ad70', 'a043aa22-7abc-476e-b63e-782ece0fe978', '4daf9a86-d69e-4a81-8529-797e1c9684a4', '818598e6-2e1a-4f48-855b-b1d406dab79f'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:08 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.718s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:08 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:08 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,created_at=2026-04-14T01:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462445815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d512caf6-a86a-4bb6-aa07-8d0caa8e789a,host='devstack@QuobyteHD#QuobyteHD',id=9d6577dc-3da2-4843-aaa5-396bd6bf6178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:08Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0fa64-28c3-4f83-8225-4d0bb52ff75d),volume_type_id=4fc0fa64-28c3-4f83-8225-4d0bb52ff75d)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Creating volume 9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:08 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a677e-773b-4bd9-94db-c71c9238c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8909b40a-66ce-4b76-b02b-031d5cc7e859', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8fe99b-a872-40d5-bfea-bd785b8351df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:08 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 (8909b40a-66ce-4b76-b02b-031d5cc7e859): created successfully Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8fe99b-a872-40d5-bfea-bd785b8351df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (1936bc52-053d-4d6c-bc40-875868ee43fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:08 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 1073741824 Apr 14 03:52:08 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-52dbeacf-92f4-4731-9b67-9eff607a1633 tempest-VolumesSnapshotTestJSON-1950238867 None] Created volume successfully. Apr 14 03:52:09 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.507s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Deleted volume successfully. Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8003e8ad-6544-4f50-b26e-1332d9709980 tempest-VolumesListAdminTestJSON-1382357458 None] Lock "cinder-f7d16c7c-c9f9-4ad8-94db-209ac7b0e0a5-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:09 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Deleted volume successfully. Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9977bf93-cb25-425a-96b8-01f03b1fee93 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-96410fe0-2bea-4e75-9ba6-a3f2206e4635-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:09 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 1073741824" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:09 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 Apr 14 03:52:09 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-9a4de1c7-8949-4c14-9da3-57f1e259f0e3-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-9a4de1c7-8949-4c14-9da3-57f1e259f0e3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-quobyte-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d4ab8-a625-4525-b462-899dd71bed66]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:09 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 Apr 14 03:52:09 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:09 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178" returned: 0 in 0.556s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.404s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating offline snapshot 9664203f-b4b2-461c-9957-d7879c4840dd of volume 8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963d0692-43b3-458c-8969-427b456d44b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677a9fd1-5ff1-4a8e-ab96-0897b169fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed0483-6b05-47c4-ac41-6ebc37e69f17]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:09 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Volume volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 (9d6577dc-3da2-4843-aaa5-396bd6bf6178): created successfully Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677a9fd1-5ff1-4a8e-ab96-0897b169fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (06c4cd42-35cf-41b9-bd3b-b996eaeb8b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-22cc87b6-9f3c-4c90-8d06-aec812346c49 tempest-GroupSnapshotsTest-824165161 None] Created volume successfully. Apr 14 03:52:10 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:10 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:10 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" returned: 0 in 0.579s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:10 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3 Apr 14 03:52:10 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:10 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.556s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:10 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd 1G Apr 14 03:52:10 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:10 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-9a4de1c7-8949-4c14-9da3-57f1e259f0e3" released by "delete_volume" :: held 1.080s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Created reservations ['d4e460e0-b36c-4068-b314-3dba4d962772', 'bc1f7469-aac4-404d-a5d3-270178ff9b27', 'f783bd08-9f48-465b-a3b1-0aadddd13680', 'bc6ab1af-d56c-4a7e-a584-d909e1ab0965'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:10 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:10 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-fb99be19-74a0-4f13-864a-46e5ee4bfe5c tempest-GroupSnapshotsTest-824165161 None] Update group completed successfully. Apr 14 03:52:11 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd 1G" returned: 0 in 0.543s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:11 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:11 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:11 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:11 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Deleted volume successfully. Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a459497-c9e4-4c77-8019-fef02ed6d0b9 tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-9a4de1c7-8949-4c14-9da3-57f1e259f0e3-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:11 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:11 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd is being set with open permissions: ugo+rw Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:11 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:11 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-d5d5deef-a269-4dd9-9156-7b17812eb772-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-d5d5deef-a269-4dd9-9156-7b17812eb772-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "cinder-quobyte-d5d5deef-a269-4dd9-9156-7b17812eb772" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-d5d5deef-a269-4dd9-9156-7b17812eb772" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87fb446-8cee-49a7-8f39-26e503430de9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:11 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 Apr 14 03:52:11 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:11 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c3fbd800-4a11-439a-94ae-39503d22c6d2 tempest-GroupSnapshotsTest-824165161 None] Update group completed successfully. Apr 14 03:52:12 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:12 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info Apr 14 03:52:12 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:12 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772" returned: 0 in 0.596s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:12 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772 Apr 14 03:52:12 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:12 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:12 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info is being set with open permissions: ugo+rw Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:12 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info Apr 14 03:52:12 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:12 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d5d5deef-a269-4dd9-9156-7b17812eb772" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-quobyte-d5d5deef-a269-4dd9-9156-7b17812eb772" released by "delete_volume" :: held 1.109s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:12 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Created reservations ['31d39da4-8331-48b0-bfd5-c2a9bdbb18e9', 'ab8e0a00-6d86-44d7-9be4-66188a622a6b', '850fff61-a304-4111-911f-6bd89d1b0415', '95f119df-b1c3-480d-a1c4-b0bf95ac7ed5'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:13 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.info" returned: 0 in 0.516s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:13 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:13 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.154s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-60b60b3e-dd8e-49a9-b5be-83ee993d46a7 tempest-VolumesSnapshotTestJSON-1950238867 None] Create snapshot completed successfully Apr 14 03:52:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-11157afe-b253-4a1c-ae7c-bd4b1972a26b tempest-GroupSnapshotsTest-824165161 None] Update group completed successfully. Apr 14 03:52:13 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Deleted volume successfully. Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9819c140-d077-4c59-9a6c-fefc86d8498d tempest-VolumesListAdminTestJSON-875583500 None] Lock "cinder-d5d5deef-a269-4dd9-9156-7b17812eb772-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Flow 'volume_create_manager' (515ee2f2-1bfe-44ae-92a3-14aeb2768e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3666f3da-cb2d-4f22-bfb1-151d2f24df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3666f3da-cb2d-4f22-bfb1-151d2f24df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1342937745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3ff30e-3bd4-432e-b539-1d0812437bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d03ec0fba4d26911d5e26a31181e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:14Z,use_quota=True,user_id='10670f4890e94e8f970042b0c16d6117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1338cb8b-9297-4ba6-a407-61ce57b5ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1338cb8b-9297-4ba6-a407-61ce57b5ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ecc11-f1cd-4282-986c-3c361d1fe34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.image.glance [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Creating Keystone auth plugin from conf {{(pid=82370) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672ecc11-f1cd-4282-986c-3c361d1fe34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d3ff30e-3bd4-432e-b539-1d0812437bf0', 'volume_name': 'volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b303501-65e8-43c6-80c1-809ad9330606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b303501-65e8-43c6-80c1-809ad9330606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c80d9d-59b7-4c68-8886-1f6b5ca0b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:13 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Trying to clone 4d3ff30e-3bd4-432e-b539-1d0812437bf0 from image 561c6fea-555e-40c4-aed9-ba813c6be050 at location (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]). {{(pid=82370) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (2c82f6fd-d3eb-48c9-9dac-7bd17fdc7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae75db42-96f7-452c-b565-72dbe7d10164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae75db42-96f7-452c-b565-72dbe7d10164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-529837914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5231a5b9-2909-4e54-9757-413f472c3cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e5344c037b4d02b7c576309f710845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9664203f-b4b2-461c-9957-d7879c4840dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:14Z,use_quota=True,user_id='ce72feb9d41442e4ad4b119ba65dfc0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10178233-08aa-4600-b3a5-aea7ee5e5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10178233-08aa-4600-b3a5-aea7ee5e5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3ff16a-9acb-4ea4-a3c8-13eb1e40f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3ff16a-9acb-4ea4-a3c8-13eb1e40f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5231a5b9-2909-4e54-9757-413f472c3cb1', 'volume_name': 'volume-5231a5b9-2909-4e54-9757-413f472c3cb1', 'volume_size': 1, 'snapshot_id': '9664203f-b4b2-461c-9957-d7879c4840dd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeff425-a50e-44c0-954e-3b2b24839689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeff425-a50e-44c0-954e-3b2b24839689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ddadc-3c58-4954-9d44-96dc2e115e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:14 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume 5231a5b9-2909-4e54-9757-413f472c3cb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5231a5b9-2909-4e54-9757-413f472c3cb1', 'volume_size': 1, 'snapshot_id': '9664203f-b4b2-461c-9957-d7879c4840dd'} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd-5231a5b9-2909-4e54-9757-413f472c3cb1" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd-5231a5b9-2909-4e54-9757-413f472c3cb1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating volume 5231a5b9-2909-4e54-9757-413f472c3cb1 from snapshot 9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] snapshot: 9664203f-b4b2-461c-9957-d7879c4840dd, volume: 5231a5b9-2909-4e54-9757-413f472c3cb1, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8042cd0-72d8-4874-a83d-8a14da0fb26d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:14 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:14 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:52:14 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:52:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-00069cfc-bd75-4499-986e-9d1b41d90f0b tempest-GroupSnapshotsTest-824165161 None] Update group completed successfully. Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea62f7-2394-4184-8a53-121287e89ac1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:14 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD Apr 14 03:52:14 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:14 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.581s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8909b40a-66ce-4b76-b02b-031d5cc7e859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab017dc-b40a-494f-9a03-2406e10bacfb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:14 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:14 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:14 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 is fetched for user 10670f4890e94e8f970042b0c16d6117. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d096215b-f5cb-415f-b2cb-8ebfc39799f0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:14 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD Apr 14 03:52:14 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:15 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:15 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 Apr 14 03:52:15 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:15 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] GroupSnapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: creating. Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Group snapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: creating. {{(pid=82370) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:52:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (981dfd53-5cb6-49c2-88a5-3e62db85f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10afe88-1667-482c-b135-6aec2651756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10afe88-1667-482c-b135-6aec2651756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2090736109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ff77fa-724f-4e9e-a44d-c28bba698b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17921115cab9492f921da6da4ad3507e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:17Z,use_quota=True,user_id='66f9f7afcbe742f1983d39ad18a83b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388b0b7-c68c-4e4c-987c-938b0311b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388b0b7-c68c-4e4c-987c-938b0311b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5b6baf-e296-42fb-b545-1e07817ab1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5b6baf-e296-42fb-b545-1e07817ab1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ff77fa-724f-4e9e-a44d-c28bba698b00', 'volume_name': 'volume-68ff77fa-724f-4e9e-a44d-c28bba698b00', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd6a76c-1506-4e5f-8826-0f88943d2785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd6a76c-1506-4e5f-8826-0f88943d2785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c977a1ac-6951-4cd8-bca2-5d0fe9036913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:17 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Volume 68ff77fa-724f-4e9e-a44d-c28bba698b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ff77fa-724f-4e9e-a44d-c28bba698b00', 'volume_size': 1} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:17 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1" returned: 0 in 2.297s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4706f7-3768-4329-8833-3c4fea933d6b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:17 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:17 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:18 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.587s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:52:18 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Converted 1024.00 MB image at 445.54 MB/s Apr 14 03:52:18 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 is being set with open permissions: ugo+rw Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:18 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 Apr 14 03:52:18 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:18 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1" returned: 0 in 0.398s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" released by "_copy_volume_from_snapshot" :: held 4.463s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd-5231a5b9-2909-4e54-9757-413f472c3cb1" released by "_create_volume_from_snapshot" :: held 4.483s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.501s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.076s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1342937745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3ff30e-3bd4-432e-b539-1d0812437bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d03ec0fba4d26911d5e26a31181e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:14Z,use_quota=True,user_id='10670f4890e94e8f970042b0c16d6117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Creating volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:18 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:18 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1073741824 Apr 14 03:52:18 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ddadc-3c58-4954-9d44-96dc2e115e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5231a5b9-2909-4e54-9757-413f472c3cb1', 'volume_size': 1, 'snapshot_id': '9664203f-b4b2-461c-9957-d7879c4840dd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c9c23d-2dee-4111-a71d-a075087cd05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:18 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Volume volume-5231a5b9-2909-4e54-9757-413f472c3cb1 (5231a5b9-2909-4e54-9757-413f472c3cb1): created successfully Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c9c23d-2dee-4111-a71d-a075087cd05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:18 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Flow 'volume_create_manager' (2c82f6fd-d3eb-48c9-9dac-7bd17fdc7144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:18 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7d13b775-5408-4511-a666-4d869781a528 tempest-VolumesSnapshotTestJSON-1950238867 None] Created volume successfully. Apr 14 03:52:19 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1073741824" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:19 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:19 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-5231a5b9-2909-4e54-9757-413f472c3cb1-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-5231a5b9-2909-4e54-9757-413f472c3cb1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2cc4f8-8984-498d-b21e-c99a673e0421]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:19 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.937s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:19 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 Apr 14 03:52:19 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Creating offline snapshot 1fc0e656-d584-4e7d-80ec-2f33fb2c56ad of volume 9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Attempting download of 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b5f2a-1025-4623-830b-846d80784a10]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef2574-43f2-4a56-aeb5-99c3eace3a98]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:19 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 Apr 14 03:52:19 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:19 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem Apr 14 03:52:19 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:19 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:19 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1 Apr 14 03:52:19 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178" returned: 0 in 0.498s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad 1G Apr 14 03:52:20 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem Apr 14 03:52:20 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5231a5b9-2909-4e54-9757-413f472c3cb1" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-5231a5b9-2909-4e54-9757-413f472c3cb1" released by "delete_volume" :: held 0.902s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['b0d5a8fc-3623-48d9-8da0-c32ea2561132', '5aae0d44-285e-4829-b0a9-d6a1cf486820', 'ee456dbd-9b68-4a86-aaab-13db7932c77c', '0f189b3a-1b33-448f-be90-e7ab0e1f4cac'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:20 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-9664203f-b4b2-461c-9957-d7879c4840dd-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad 1G" returned: 0 in 0.515s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem" returned: 1 in 0.523s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_xsujgnem' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-9664203f-b4b2-461c-9957-d7879c4840dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f16ba-5d64-4394-8ec8-76e525197315]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad Apr 14 03:52:20 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Deleting offline snapshot 9664203f-b4b2-461c-9957-d7879c4840dd of volume 8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] snapshot_file for this snap is: volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63839c-665c-48a0-9786-134ed392f95e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:20 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD Apr 14 03:52:20 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:20 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:20 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Deleted volume successfully. Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bbffd4dc-6394-4c0a-90f0-0bbeb71ef4eb tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-5231a5b9-2909-4e54-9757-413f472c3cb1-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:20 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" returned: 0 in 0.445s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:20 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad Apr 14 03:52:21 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] 561c6fea-555e-40c4-aed9-ba813c6be050 was qcow2, converting to raw {{(pid=82370) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:21 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8909b40a-66ce-4b76-b02b-031d5cc7e859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4afc1-ca4a-43a3-b405-60af43e6330f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:21 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info Apr 14 03:52:21 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:21 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 0 in 0.846s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_b30zu842devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:52:21 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Converted 112.00 MB image at 112.00 MB/s Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:21 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1G Apr 14 03:52:21 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:21 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info" returned: 0 in 0.546s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:21 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info Apr 14 03:52:22 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:22 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.516s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd Apr 14 03:52:22 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:22 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 1G" returned: 0 in 0.441s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e04927-2664-49a1-980d-9ee55b0789f9]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.info" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:22 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:22 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Creating offline snapshot cbe1f558-8844-423a-ad78-3a5d44dbaab8 of volume 9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a149c35b-a83e-475f-87bb-722e724f0694]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 Apr 14 03:52:22 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:22 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859.9664203f-b4b2-461c-9957-d7879c4840dd" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-9664203f-b4b2-461c-9957-d7879c4840dd" released by "_delete_snapshot" :: held 2.028s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" released by "delete_snapshot" :: held 2.040s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['d7a03f9e-c24e-4ecc-860c-43580f8744c7', '49f80e6e-03a4-425e-8184-c5fdbacbca04', 'e0e4f0a5-02ad-4c4f-89aa-0fdd85e50e18', '8d1f3427-e3d2-4e73-b7a0-60c88869a8c2'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:22 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Delete snapshot completed successfully. Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be43c930-15b3-408a-8ab9-990db65f643d tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-9664203f-b4b2-461c-9957-d7879c4840dd-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:22 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:22 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:22 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:22 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 1G Apr 14 03:52:22 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:23 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 1 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Downloaded image 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0 successfully. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 for user 10670f4890e94e8f970042b0c16d6117 is deleted. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Marking volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0 as bootable. {{(pid=82370) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Copying metadata from image 561c6fea-555e-40c4-aed9-ba813c6be050 to 4d3ff30e-3bd4-432e-b539-1d0812437bf0. {{(pid=82370) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Creating volume glance metadata for volume 4d3ff30e-3bd4-432e-b539-1d0812437bf0 backed by image 561c6fea-555e-40c4-aed9-ba813c6be050 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82370) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c80d9d-59b7-4c68-8886-1f6b5ca0b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d862448-088f-4507-b7fd-93ea93e62146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:23 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Volume volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 (4d3ff30e-3bd4-432e-b539-1d0812437bf0): created successfully Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d862448-088f-4507-b7fd-93ea93e62146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Flow 'volume_create_manager' (515ee2f2-1bfe-44ae-92a3-14aeb2768e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:23 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 1G" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e431329-5443-47ac-9302-f95f672be397 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:23 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a9994b23-24f5-4682-8476-dee9d9dfa0f4 tempest-VolumesImageMetadata-907357995 None] Created volume successfully. Apr 14 03:52:23 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e431329-5443-47ac-9302-f95f672be397 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 Apr 14 03:52:23 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-8909b40a-66ce-4b76-b02b-031d5cc7e859-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-8909b40a-66ce-4b76-b02b-031d5cc7e859-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6408cefa-357e-496e-ab60-5f5e29f8acbf]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:23 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e431329-5443-47ac-9302-f95f672be397 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8" returned: 0 in 0.457s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:23 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:23 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 Apr 14 03:52:23 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:23 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:23 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:24 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:24 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info Apr 14 03:52:24 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:24 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:24 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859 Apr 14 03:52:24 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Acquiring lock "cinder-4d3ff30e-3bd4-432e-b539-1d0812437bf0-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "cinder-4d3ff30e-3bd4-432e-b539-1d0812437bf0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Acquiring lock "cinder-quobyte-4d3ff30e-3bd4-432e-b539-1d0812437bf0" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "cinder-quobyte-4d3ff30e-3bd4-432e-b539-1d0812437bf0" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[94baf737-c8be-45b8-984e-5017307288a5]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:24 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:24 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:24 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:24 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:24 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info Apr 14 03:52:24 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:24 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8909b40a-66ce-4b76-b02b-031d5cc7e859" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-8909b40a-66ce-4b76-b02b-031d5cc7e859" released by "delete_volume" :: held 1.029s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['df564e48-1ceb-427e-a3fc-e61f2484470e', '56b9b817-8a19-4417-91bb-d93cb92417f9', 'f244c1f5-9637-4f8a-bbca-7f3c130610b9', '81feb60e-9257-45c7-8597-1247ac778274'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:24 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:24 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:25 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:25 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:25 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:25 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.info" returned: 0 in 0.451s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.716s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2090736109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ff77fa-724f-4e9e-a44d-c28bba698b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17921115cab9492f921da6da4ad3507e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:17Z,use_quota=True,user_id='66f9f7afcbe742f1983d39ad18a83b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Creating volume 68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:25 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 1073741824 Apr 14 03:52:25 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cbbda0a0-4317-4bdb-b113-16e1648b45a6 tempest-GroupSnapshotsTest-824165161 None] group_snapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: created successfully Apr 14 03:52:25 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Deleted volume successfully. Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9b5a4930-6207-4ccb-8f77-ac517598ffa4 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-8909b40a-66ce-4b76-b02b-031d5cc7e859-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:25 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 1 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:25 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0 Apr 14 03:52:25 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:25 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 1073741824" returned: 0 in 0.517s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:25 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 Apr 14 03:52:25 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] group_snapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: deleting Apr 14 03:52:26 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-1c13d156-1e22-48ef-a460-3ee426d4e4c7-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d3ff30e-3bd4-432e-b539-1d0812437bf0" returned: 0 in 0.442s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] group_snapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: deleting {{(pid=82370) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "cinder-quobyte-4d3ff30e-3bd4-432e-b539-1d0812437bf0" released by "delete_volume" :: held 1.464s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-1c13d156-1e22-48ef-a460-3ee426d4e4c7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Created reservations ['4fde841d-ecb3-4ac4-abc2-1387238e8cd9', '35cb50f5-4002-4caa-86bf-0a0fae5874fb', '5737243c-6ad4-47af-9511-4c0e7f44d63f', 'c7a3e57d-edea-4496-9f4a-fffd33f19b58'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Deleting offline snapshot 1fc0e656-d584-4e7d-80ec-2f33fb2c56ad of volume 9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] snapshot_file for this snap is: volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" acquired by "delete_volume" :: waited 0.041s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba2cbc-368f-4532-82eb-34396202c3b9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7093744-f648-400f-a4bb-9da6d83c8350]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:26 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:26 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:26 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c977a1ac-6951-4cd8-bca2-5d0fe9036913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ff77fa-724f-4e9e-a44d-c28bba698b00', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:26 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad Apr 14 03:52:26 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b13fb-585f-45e0-b755-1541c0089721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:26 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 Apr 14 03:52:26 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Volume volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 (68ff77fa-724f-4e9e-a44d-c28bba698b00): created successfully Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b13fb-585f-45e0-b755-1541c0089721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (981dfd53-5cb6-49c2-88a5-3e62db85f903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-de23054d-2864-4be4-8fbf-fa738fdbad17 tempest-VolumesDeleteCascade-635874153 None] Created volume successfully. Apr 14 03:52:26 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7" returned: 0 in 0.465s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:26 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Deleted volume successfully. Apr 14 03:52:26 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:DELETE=22,cinder:SELECT=205,cinder:UPDATE=240,cinder:INSERT=67 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:26 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7 Apr 14 03:52:26 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[04397c99-b279-41b0-baf1-624490f6d5d6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-202dd49d-988e-4029-93f4-5e793e52c37d tempest-VolumesImageMetadata-907357995 None] Lock "cinder-4d3ff30e-3bd4-432e-b539-1d0812437bf0-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:26 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 Apr 14 03:52:26 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=267,cinder:SELECT=256,cinder:INSERT=62,cinder:DELETE=16 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Creating offline snapshot 7ece82bc-f0ea-4787-92b9-05efe8f9498e of volume 68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da0442-ca0c-4706-9cba-4b5e5c620b7c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:27 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1c13d156-1e22-48ef-a460-3ee426d4e4c7" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:27 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 Apr 14 03:52:27 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-quobyte-1c13d156-1e22-48ef-a460-3ee426d4e4c7" released by "delete_volume" :: held 1.004s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Created reservations ['f418ce88-cdae-4724-954c-c46a491eddf4', 'e2115ffc-1bb6-4cd5-a6a6-cd6875fc5860', '90d24df2-eeff-43f0-a2e6-b8a74b4efb4a', '584df66c-2aed-4961-91a0-8700ac020799'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:27 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178" returned: 0 in 0.576s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:27 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:27 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:27 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad Apr 14 03:52:27 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:27 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00" returned: 0 in 0.543s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:27 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e 1G Apr 14 03:52:27 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:27 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.458s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:27 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Deleted volume successfully. Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c050822-c9ab-4ec7-8b36-59675ce587f1 tempest-VolumesSnapshotTestJSON-1950238867 None] Lock "cinder-1c13d156-1e22-48ef-a460-3ee426d4e4c7-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:27 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" returned: 0 in 0.547s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:27 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad Apr 14 03:52:27 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:28 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e 1G" returned: 0 in 0.576s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:28 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:28 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:28 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178.1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" returned: 0 in 0.493s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-1fc0e656-d584-4e7d-80ec-2f33fb2c56ad" released by "_delete_snapshot" :: held 2.223s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" released by "delete_snapshot" :: held 2.254s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-cbe1f558-8844-423a-ad78-3a5d44dbaab8" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-cbe1f558-8844-423a-ad78-3a5d44dbaab8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Deleting offline snapshot cbe1f558-8844-423a-ad78-3a5d44dbaab8 of volume 9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] snapshot_file for this snap is: volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd13a8-8289-4f61-a89c-50bdfc6924c4]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:28 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 Apr 14 03:52:28 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:28 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.541s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:28 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e is being set with open permissions: ugo+rw Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:28 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:28 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:28 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8" returned: 0 in 0.584s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e431329-5443-47ac-9302-f95f672be397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[766829b5-ced9-4fe4-8ce3-bc3bae37d1c8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:29 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 Apr 14 03:52:29 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:29 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:29 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info Apr 14 03:52:29 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Flow 'volume_create_manager' (b0d42711-067d-4150-b4bc-49160c3d6aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42e225c-1456-4694-b49e-e35bac1b4268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42e225c-1456-4694-b49e-e35bac1b4268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-547179929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7560f824f24aa591134c62d7f6fb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:29Z,use_quota=True,user_id='0fe52a62dd8b449594acfaac8e53d19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9d7c8c-99ea-40fb-8c0b-40e8fbf80e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9d7c8c-99ea-40fb-8c0b-40e8fbf80e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483ffeb-d1ce-4081-89ef-542ee8853119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483ffeb-d1ce-4081-89ef-542ee8853119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4', 'volume_name': 'volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b2bab-fbf7-485e-b68f-6bba5feeb041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b2bab-fbf7-485e-b68f-6bba5feeb041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bec34dd-9277-4117-b3e2-018e2ae38f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:29 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Volume 4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4', 'volume_size': 1} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:29 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397" returned: 0 in 0.610s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:29 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 Apr 14 03:52:29 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:29 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:29 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info is being set with open permissions: ugo+rw Apr 14 03:52:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:29 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info Apr 14 03:52:29 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:30 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8" returned: 0 in 0.489s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:30 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8 Apr 14 03:52:30 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:30 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.info" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.232s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-547179929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7560f824f24aa591134c62d7f6fb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:29Z,use_quota=True,user_id='0fe52a62dd8b449594acfaac8e53d19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Creating volume 4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:30 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:30 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 1073741824 Apr 14 03:52:30 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:30 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-55b652c2-dda6-42ea-abcc-c7ff5abd9eac tempest-VolumesDeleteCascade-635874153 None] Create snapshot completed successfully Apr 14 03:52:30 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397.cbe1f558-8844-423a-ad78-3a5d44dbaab8" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-cbe1f558-8844-423a-ad78-3a5d44dbaab8" released by "_delete_snapshot" :: held 2.255s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" released by "delete_snapshot" :: held 2.271s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:30 devstack cinder-volume[82370]: WARNING cinder.quota [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-287597753 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-287597753, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:30 devstack cinder-volume[82370]: WARNING cinder.quota [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-287597753 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-287597753, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['0e495958-b53c-478c-a256-8213c6170534', '4c0658ef-0e7c-4209-9743-8259133e771f', 'd4eb8711-8b76-47a6-9d0b-e1d0a64003ae', '3e20589f-b8de-42ff-8669-ad5ed4ee42bb'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['28707657-b267-4c81-89b0-58e5eb53b2df', '9eb00ec6-c376-42f9-97d0-8ff43450ba75', '35405e42-3541-4d20-8421-59e4883fc903', '7d0747f2-3924-4908-bb34-4b105462f1d8'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:30 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-77056cf1-bf2e-4728-ad8a-2d738b9ec116 tempest-GroupSnapshotsTest-824165161 None] group_snapshot dbfdadee-6d0f-451f-a252-9d0eac135bdc: deleted successfully Apr 14 03:52:30 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 1073741824" returned: 0 in 0.637s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:30 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 Apr 14 03:52:30 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:31 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bec34dd-9277-4117-b3e2-018e2ae38f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c0a147-5bf2-4803-9025-d857130d6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Creating offline snapshot 4015174f-9392-4683-86dd-a3b8939b5a52 of volume 68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:31 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Volume volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 (4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4): created successfully Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c0a147-5bf2-4803-9025-d857130d6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Flow 'volume_create_manager' (b0d42711-067d-4150-b4bc-49160c3d6aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdefc3c-07a3-4510-bc03-2b2228dc64e7]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:31 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3a84810e-fe52-4758-969e-3dda6f39522c tempest-VolumesTransfersV357Test-2069213450 None] Created volume successfully. Apr 14 03:52:31 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:31 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5b16b-d78a-4a7a-8208-68cd6494402c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:31 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 Apr 14 03:52:31 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:32 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.623s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ff77fa-724f-4e9e-a44d-c28bba698b00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:32 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 1G Apr 14 03:52:32 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-002e37ee-069b-4b12-aae7-f73cbbdf481f tempest-VolumesTransfersV357Test-1087501234 None] Transfer volume completed successfully. Apr 14 03:52:32 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178" returned: 0 in 0.540s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:32 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178 Apr 14 03:52:32 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Flow 'volume_create_manager' (7943bfa4-783d-407f-a23b-18d77212e0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478380dd-f390-4501-a11e-da25e299cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478380dd-f390-4501-a11e-da25e299cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1784588610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b3e71-2b3c-4279-8b55-1a027cf05dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5cda433094bd683274e46289dfcfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:32Z,use_quota=True,user_id='b2a14874fdd84fd88a04e63c845bc3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e3814-7675-4fdd-a0e5-8cae59ba58da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e3814-7675-4fdd-a0e5-8cae59ba58da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4b5b22-c4f6-4e2f-9283-3898dc6d6808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4b5b22-c4f6-4e2f-9283-3898dc6d6808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070b3e71-2b3c-4279-8b55-1a027cf05dcc', 'volume_name': 'volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc', 'volume_size': 2}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce7b2d4-70c1-49e9-ba3d-e9f41ad87ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce7b2d4-70c1-49e9-ba3d-e9f41ad87ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e1a703-50e4-44d4-aa90-e164d869c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:32 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Volume 070b3e71-2b3c-4279-8b55-1a027cf05dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc', 'volume_size': 2} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:32 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 1G" returned: 0 in 0.535s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:32 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 Apr 14 03:52:32 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:32 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9d6577dc-3da2-4843-aaa5-396bd6bf6178" returned: 0 in 0.447s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9d6577dc-3da2-4843-aaa5-396bd6bf6178" released by "delete_volume" :: held 1.021s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b6e739-dbc4-41f3-8535-51e4758819ec]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:32 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 Apr 14 03:52:32 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "cinder-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "cinder-quobyte-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-quobyte-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4a9fa2-f00e-4bbf-a8fa-a43e3c2b573c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 Apr 14 03:52:33 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52" returned: 0 in 0.526s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:33 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 is being set with open permissions: ugo+rw Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 Apr 14 03:52:33 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397" returned: 0 in 0.518s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397 Apr 14 03:52:33 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52" returned: 0 in 0.407s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:33 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" returned: 0 in 0.517s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4 Apr 14 03:52:33 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1784588610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070b3e71-2b3c-4279-8b55-1a027cf05dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b5cda433094bd683274e46289dfcfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:32Z,use_quota=True,user_id='b2a14874fdd84fd88a04e63c845bc3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Creating volume 070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:33 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc 2147483648 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc 2147483648 Apr 14 03:52:33 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-da6b759e-3f30-4ec3-85ee-3bcbe0c74f21 tempest-VolumesDeleteCascade-635874153 None] Create snapshot completed successfully Apr 14 03:52:33 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e431329-5443-47ac-9302-f95f672be397" returned: 0 in 0.445s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-9e431329-5443-47ac-9302-f95f672be397" released by "delete_volume" :: held 0.996s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Created reservations ['3aa53461-b647-44e1-afd5-de899b378e01'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:33 devstack cinder-volume[82370]: WARNING cinder.quota [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-287597753 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-287597753, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Created reservations ['640e13b9-683a-4e97-b8be-0bc90e8d9828', '324f87af-70b3-4387-be6d-4f85f0cfde24', '0b5f3f6e-867a-4c47-ac7e-8f1a2c563d49', 'c19ec330-a7e7-4892-b725-5f83cd6beb48'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Created reservations ['2b2a7934-dad6-4fad-871f-29a923641469', '080a5623-42ac-47d9-8f9d-8fa3413b406a', '981eb406-adf7-4dbb-a1e4-c243d6f0b490', 'af0bb7dc-652d-4a85-88d1-62f7ffb9efce'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:33 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:33 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:34 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" returned: 0 in 0.422s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-quobyte-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4" released by "delete_volume" :: held 0.964s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Created reservations ['ca45d9ea-867a-4511-9f02-d5f6479b664b', '9ae22d39-1d1a-43c5-ba16-04bcc95e20d4', '90b19c80-22b3-4b31-a2f0-6ba36f32c5d1', 'ef31b591-ed0a-45be-a0c7-81eb817b7da6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:34 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:34 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:34 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc 2147483648" returned: 0 in 0.605s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bcb31fe9-14d4-4651-b2d5-a8aec1a2c3f9 tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-339344022: creating Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bcb31fe9-14d4-4651-b2d5-a8aec1a2c3f9 tempest-GroupSnapshotsTest-824165161 None] Group tempest-GroupSnapshotsTest-Group-339344022: created successfully Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bcb31fe9-14d4-4651-b2d5-a8aec1a2c3f9 tempest-GroupSnapshotsTest-824165161 None] Create group completed successfully. Apr 14 03:52:34 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc Apr 14 03:52:34 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-68ff77fa-724f-4e9e-a44d-c28bba698b00-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:34 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.652s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Flow 'volume_create_manager' (d097e2c3-3526-4761-9c4b-e26aa14e4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5953e6-bced-4f2c-8bdb-e6aa0b32f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-68ff77fa-724f-4e9e-a44d-c28bba698b00-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0366c388-1d44-489a-8e8f-09ebdf1a0d2f tempest-GroupSnapshotsTest-824165161 None] Delete group completed successfully. Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5953e6-bced-4f2c-8bdb-e6aa0b32f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-179316727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7029c3-cf6b-4886-b238-512cf0f211ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7560f824f24aa591134c62d7f6fb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:35Z,use_quota=True,user_id='0fe52a62dd8b449594acfaac8e53d19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a893a8b4-2d88-4958-bf58-122072121ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a893a8b4-2d88-4958-bf58-122072121ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c304fa-b8d0-4f92-909c-d617c68070b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c304fa-b8d0-4f92-909c-d617c68070b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7029c3-cf6b-4886-b238-512cf0f211ab', 'volume_name': 'volume-ce7029c3-cf6b-4886-b238-512cf0f211ab', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86176e29-4a2f-4f37-abb6-5c0d03ac38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86176e29-4a2f-4f37-abb6-5c0d03ac38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541bfcd-b9ce-4eef-a7b6-29c771bde0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Volume ce7029c3-cf6b-4886-b238-512cf0f211ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7029c3-cf6b-4886-b238-512cf0f211ab', 'volume_size': 1} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.560s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Performing cascade delete. {{(pid=82370) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Deleted volume successfully. Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-4015174f-9392-4683-86dd-a3b8939b5a52-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-729c9ae8-01bb-4de8-a487-bdd159578db2 tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-4d7c4bf4-ab40-4bf6-9089-cd290bbc0da4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-4015174f-9392-4683-86dd-a3b8939b5a52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-4015174f-9392-4683-86dd-a3b8939b5a52" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-4015174f-9392-4683-86dd-a3b8939b5a52" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Deleting offline snapshot 4015174f-9392-4683-86dd-a3b8939b5a52 of volume 68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] snapshot_file for this snap is: volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[57815148-47c4-49cc-b108-c6d855e07864]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:34 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 Apr 14 03:52:34 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:34 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc" returned: 0 in 0.550s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-179316727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7029c3-cf6b-4886-b238-512cf0f211ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7560f824f24aa591134c62d7f6fb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:35Z,use_quota=True,user_id='0fe52a62dd8b449594acfaac8e53d19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Creating volume ce7029c3-cf6b-4886-b238-512cf0f211ab {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e1a703-50e4-44d4-aa90-e164d869c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc', 'volume_size': 2}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c29760a-2013-46a4-9ec3-93e50c9bfd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:34 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab 1073741824 Apr 14 03:52:34 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Volume volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc (070b3e71-2b3c-4279-8b55-1a027cf05dcc): created successfully Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c29760a-2013-46a4-9ec3-93e50c9bfd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Flow 'volume_create_manager' (7943bfa4-783d-407f-a23b-18d77212e0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-98302d4f-0821-49c7-98f0-6ee586dd49a0 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Created volume successfully. Apr 14 03:52:35 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ff77fa-724f-4e9e-a44d-c28bba698b00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d10de6-526c-4f3d-90dc-5f2ca10ff73c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:35 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:35 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:35 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab 1073741824" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:35 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab Apr 14 03:52:35 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (7ddc0563-b164-47b8-a30e-e5ce113ca1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acffefb-876f-4a06-8465-adfc55e46ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acffefb-876f-4a06-8465-adfc55e46ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430028112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a697af9e-7cca-49ee-b6db-accd31216896,host='devstack@QuobyteHD#QuobyteHD',id=c3527d75-819e-4bdd-940a-83738d82a145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:36Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(695e38bc-9947-4a3b-9776-c715bebeb366),volume_type_id=695e38bc-9947-4a3b-9776-c715bebeb366)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1311bf63-7ae3-4733-a770-868223a98506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1311bf63-7ae3-4733-a770-868223a98506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f92a06-46e4-4d56-b73e-253df3447fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f92a06-46e4-4d56-b73e-253df3447fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3527d75-819e-4bdd-940a-83738d82a145', 'volume_name': 'volume-c3527d75-819e-4bdd-940a-83738d82a145', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f9fbb6-446c-40fc-97c0-7ba67d94e44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f9fbb6-446c-40fc-97c0-7ba67d94e44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e86037-ca54-4bc7-8ea6-12ed0519fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Volume c3527d75-819e-4bdd-940a-83738d82a145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3527d75-819e-4bdd-940a-83738d82a145', 'volume_size': 1} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:35 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.590s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ff77fa-724f-4e9e-a44d-c28bba698b00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:35 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 Apr 14 03:52:35 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:35 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab" returned: 0 in 0.512s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.186s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a697af9e-7cca-49ee-b6db-accd31216896,created_at=2026-04-14T01:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430028112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a697af9e-7cca-49ee-b6db-accd31216896,host='devstack@QuobyteHD#QuobyteHD',id=c3527d75-819e-4bdd-940a-83738d82a145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37db9b8706d842be82d69d8314aa6e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:36Z,use_quota=True,user_id='912a609167864d20b0f5bd6725495bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(695e38bc-9947-4a3b-9776-c715bebeb366),volume_type_id=695e38bc-9947-4a3b-9776-c715bebeb366)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Creating volume c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:35 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541bfcd-b9ce-4eef-a7b6-29c771bde0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7029c3-cf6b-4886-b238-512cf0f211ab', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 1073741824 Apr 14 03:52:35 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b90ccc-f5d5-4ff4-8786-c2806bcd8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:35 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Volume volume-ce7029c3-cf6b-4886-b238-512cf0f211ab (ce7029c3-cf6b-4886-b238-512cf0f211ab): created successfully Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b90ccc-f5d5-4ff4-8786-c2806bcd8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Flow 'volume_create_manager' (d097e2c3-3526-4761-9c4b-e26aa14e4e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b6999ae0-3713-4a75-87d8-dfd300f08c9f tempest-VolumesTransfersV357Test-2069213450 None] Created volume successfully. Apr 14 03:52:36 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52" returned: 0 in 0.481s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:36 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52 Apr 14 03:52:36 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:36 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 1073741824" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:36 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 Apr 14 03:52:36 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:36 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.4015174f-9392-4683-86dd-a3b8939b5a52" returned: 0 in 0.429s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-4015174f-9392-4683-86dd-a3b8939b5a52" released by "_delete_snapshot" :: held 2.031s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" released by "delete_snapshot" :: held 2.041s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Created reservations ['83ce8c65-0795-4739-b132-7914be4c404f', '2fa8b005-d26c-4afa-95f9-e0c5da27a236', 'b3b88d7b-0a84-4901-a806-e282dbd1b131', '2919be6b-c24c-4dfc-bc22-c6aa621c9730'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Delete snapshot completed successfully. Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-4015174f-9392-4683-86dd-a3b8939b5a52-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-7ece82bc-f0ea-4787-92b9-05efe8f9498e-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:36 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-7ece82bc-f0ea-4787-92b9-05efe8f9498e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.124s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e86037-ca54-4bc7-8ea6-12ed0519fce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3527d75-819e-4bdd-940a-83738d82a145', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94396f0f-26e3-4bb4-82b0-4e62b326fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-7ece82bc-f0ea-4787-92b9-05efe8f9498e" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "cinder-ce7029c3-cf6b-4886-b238-512cf0f211ab-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:36 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Volume volume-c3527d75-819e-4bdd-940a-83738d82a145 (c3527d75-819e-4bdd-940a-83738d82a145): created successfully Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94396f0f-26e3-4bb4-82b0-4e62b326fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Flow 'volume_create_manager' (7ddc0563-b164-47b8-a30e-e5ce113ca1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Creating offline snapshot de85f5f3-6a97-4964-80d5-aaafe25dbd21 of volume 070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d704fae3-a165-4d19-bee0-271687d3c470 tempest-GroupSnapshotsTest-824165161 None] Created volume successfully. Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-7ece82bc-f0ea-4787-92b9-05efe8f9498e" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Deleting offline snapshot 7ece82bc-f0ea-4787-92b9-05efe8f9498e of volume 68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] snapshot_file for this snap is: volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29670e0-65b5-4ff7-bece-6795facfec08]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-ce7029c3-cf6b-4886-b238-512cf0f211ab-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc795ac-f37d-427f-8589-76855715951e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "cinder-quobyte-ce7029c3-cf6b-4886-b238-512cf0f211ab" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-quobyte-ce7029c3-cf6b-4886-b238-512cf0f211ab" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4311010-c0b0-46c4-bd65-db6480580351]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:37 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc Apr 14 03:52:37 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:37 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab Apr 14 03:52:37 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 2G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:37 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 2G Apr 14 03:52:37 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ff77fa-724f-4e9e-a44d-c28bba698b00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f7af7-17c7-4dcb-a4e2-77f482194416]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:37 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:37 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab Apr 14 03:52:37 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 Apr 14 03:52:37 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] GroupSnapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: creating. Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Group snapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: creating. {{(pid=82370) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:52:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:38 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 2G" returned: 0 in 0.583s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 Apr 14 03:52:38 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:38 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ce7029c3-cf6b-4886-b238-512cf0f211ab" returned: 0 in 0.530s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-quobyte-ce7029c3-cf6b-4886-b238-512cf0f211ab" released by "delete_volume" :: held 1.032s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00" returned: 0 in 0.575s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Created reservations ['6b957da8-253a-4151-a19a-42086e233ea9', '04823922-6984-4284-a270-60df2e7efc9e', '9f90a89d-e75f-4ce3-b8e0-b0cf3ca21d22', '35dd4b77-4261-4095-8231-47dd9d81da17'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:38 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:38 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:38 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:38 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21" returned: 0 in 0.454s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 is being set with open permissions: ugo+rw Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 Apr 14 03:52:38 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:38 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.496s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.433s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:38 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e Apr 14 03:52:38 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Deleted volume successfully. Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-86830d53-bb83-40ef-9062-715226bd036f tempest-VolumesTransfersV357Test-41987910 None] Lock "cinder-ce7029c3-cf6b-4886-b238-512cf0f211ab-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:38 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:38 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info Apr 14 03:52:38 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:39 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00.7ece82bc-f0ea-4787-92b9-05efe8f9498e" returned: 0 in 0.448s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-7ece82bc-f0ea-4787-92b9-05efe8f9498e" released by "_delete_snapshot" :: held 2.071s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" released by "delete_snapshot" :: held 2.124s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Created reservations ['1b2f430d-94f1-4742-b84d-85c22d49bc7e', '1dc4f4f2-0b9d-407c-a6f9-4f67168c1ead', '59c7d38a-30e8-4ac0-bb09-c03643f35061', '202348f6-938b-4b2e-a21a-c00a86b200f9'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Delete snapshot completed successfully. Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-7ece82bc-f0ea-4787-92b9-05efe8f9498e-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Snapshots deleted, issuing volume delete {{(pid=82370) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ac4c63-bb33-45cd-b9de-1811d30e4dba]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:39 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 Apr 14 03:52:39 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:39 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info" returned: 0 in 0.547s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:39 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info is being set with open permissions: ugo+rw Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:39 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info Apr 14 03:52:39 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:39 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00" returned: 0 in 0.541s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:39 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00 Apr 14 03:52:39 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:40 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.info" returned: 0 in 0.526s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.122s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Creating offline snapshot f833f1ea-0b9e-4364-b31b-6bc60a01b690 of volume c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-878cab03-6956-4c10-8d85-73a59017e6d3 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Create snapshot completed successfully Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fe3bc-e539-41a5-94ee-6828b3297308]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:40 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 Apr 14 03:52:40 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:40 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-68ff77fa-724f-4e9e-a44d-c28bba698b00" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-68ff77fa-724f-4e9e-a44d-c28bba698b00" released by "delete_volume" :: held 1.047s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Created reservations ['3a1a0205-c517-4da8-98f9-761a2e363af8', 'ee0089f4-b8db-438f-81b7-55ad2c0cd85a', '32ca5017-a8ca-42fc-a3b7-61b0e8de5495', 'f3f43c3c-d55f-4058-92e2-e1ca91ea9668'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:40 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:40 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:40 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145" returned: 0 in 0.550s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:40 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 1G Apr 14 03:52:40 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:40 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Deleted volume successfully. Apr 14 03:52:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-da39d9c8-39df-4f13-8820-71751c4db37f tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-68ff77fa-724f-4e9e-a44d-c28bba698b00-delete_volume" released by "delete_volume" :: held 6.186s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "cinder-de85f5f3-6a97-4964-80d5-aaafe25dbd21-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-de85f5f3-6a97-4964-80d5-aaafe25dbd21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "cinder-quobyte-de85f5f3-6a97-4964-80d5-aaafe25dbd21" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-de85f5f3-6a97-4964-80d5-aaafe25dbd21" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Deleting offline snapshot de85f5f3-6a97-4964-80d5-aaafe25dbd21 of volume 070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] snapshot_file for this snap is: volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e47a57-e978-4e99-8dd0-4d063b41b180]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:41 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 Apr 14 03:52:41 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:41 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 1G" returned: 0 in 0.625s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3527d75-819e-4bdd-940a-83738d82a145 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:41 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3527d75-819e-4bdd-940a-83738d82a145 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 Apr 14 03:52:41 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (f622a542-5b6f-487a-b7c1-fccffd522f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336d96d6-f9cc-493a-af24-2e6275a1dfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336d96d6-f9cc-493a-af24-2e6275a1dfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1643569478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b61664-7eab-41cb-8506-6d65d19dc315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17921115cab9492f921da6da4ad3507e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:41Z,use_quota=True,user_id='66f9f7afcbe742f1983d39ad18a83b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36f2cf-6cf2-4afa-b43c-cce879b396a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36f2cf-6cf2-4afa-b43c-cce879b396a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d377261-0f90-4b5d-b5f7-7b68d92f5bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d377261-0f90-4b5d-b5f7-7b68d92f5bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b61664-7eab-41cb-8506-6d65d19dc315', 'volume_name': 'volume-a7b61664-7eab-41cb-8506-6d65d19dc315', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64e19c6-798d-42bc-a5dc-b1c36bf10273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64e19c6-798d-42bc-a5dc-b1c36bf10273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca2854-fd8e-4126-871c-e83fd2efb3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:41 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Volume a7b61664-7eab-41cb-8506-6d65d19dc315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b61664-7eab-41cb-8506-6d65d19dc315', 'volume_size': 1} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:41 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3527d75-819e-4bdd-940a-83738d82a145 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690" returned: 0 in 0.507s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:41 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:41 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21" returned: 0 in 0.610s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:41 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:41 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba21998-204b-421a-8624-66adef3cf0ad]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:41 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc Apr 14 03:52:41 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:42 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690" returned: 0 in 0.453s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:42 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info Apr 14 03:52:42 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:42 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc" returned: 0 in 0.512s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:42 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 Apr 14 03:52:42 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:42 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:42 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:42 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info Apr 14 03:52:42 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:42 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21" returned: 0 in 0.554s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:42 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21 Apr 14 03:52:42 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:43 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.info" returned: 0 in 0.485s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.168s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1643569478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b61664-7eab-41cb-8506-6d65d19dc315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17921115cab9492f921da6da4ad3507e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:41Z,use_quota=True,user_id='66f9f7afcbe742f1983d39ad18a83b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Creating volume a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:43 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:43 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 1073741824 Apr 14 03:52:43 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:43 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4385db47-1564-4aca-ade0-1d9b9da450b6 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: created successfully Apr 14 03:52:43 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc.de85f5f3-6a97-4964-80d5-aaafe25dbd21" returned: 0 in 0.432s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-de85f5f3-6a97-4964-80d5-aaafe25dbd21" released by "_delete_snapshot" :: held 2.172s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" released by "delete_snapshot" :: held 2.190s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Created reservations ['0e2a7cf0-3e14-4d0d-a75f-f757b788c3a3', '5c63f161-d8c7-4df2-9591-8ed78d53edb5', '1065008b-4e82-4ec8-98f0-ec3c7262a87e', '66d3e468-d868-4d98-b80b-79b5b3759ff4'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:43 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Delete snapshot completed successfully. Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3cab1ca1-9db6-47d3-a6e3-585a18893259 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-de85f5f3-6a97-4964-80d5-aaafe25dbd21-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:43 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 1073741824" returned: 0 in 0.590s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:43 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:43 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: deleting Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: deleting {{(pid=82370) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:52:44 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "cinder-070b3e71-2b3c-4279-8b55-1a027cf05dcc-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fca2854-fd8e-4126-871c-e83fd2efb3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b61664-7eab-41cb-8506-6d65d19dc315', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9bb7a5-9d52-4e39-be88-45ee88d52084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Volume volume-a7b61664-7eab-41cb-8506-6d65d19dc315 (a7b61664-7eab-41cb-8506-6d65d19dc315): created successfully Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9bb7a5-9d52-4e39-be88-45ee88d52084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (f622a542-5b6f-487a-b7c1-fccffd522f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-070b3e71-2b3c-4279-8b55-1a027cf05dcc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-f833f1ea-0b9e-4364-b31b-6bc60a01b690" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-feef02fc-b2e2-4fcb-b7a8-0b55ac56130a tempest-VolumesDeleteCascade-635874153 None] Created volume successfully. Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-f833f1ea-0b9e-4364-b31b-6bc60a01b690" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Deleting offline snapshot f833f1ea-0b9e-4364-b31b-6bc60a01b690 of volume c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] snapshot_file for this snap is: volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8423f1e-54c3-488c-a871-dc728e037303]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c885c67-3246-49d2-8023-b568087945d5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:44 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 Apr 14 03:52:44 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:44 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc Apr 14 03:52:44 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Creating offline snapshot 070dd2a9-c2c8-4373-bb26-3a8aae68b96c of volume a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fce22a-b582-46d3-9ec1-d6c495f8e270]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:44 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:44 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:44 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3527d75-819e-4bdd-940a-83738d82a145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22f17a-2242-4045-84e8-34cfab8508ae]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc" returned: 0 in 0.542s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc Apr 14 03:52:45 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:45 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 Apr 14 03:52:45 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:45 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c 1G Apr 14 03:52:45 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:45 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-070b3e71-2b3c-4279-8b55-1a027cf05dcc" returned: 0 in 0.499s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:45 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 Apr 14 03:52:45 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-quobyte-070b3e71-2b3c-4279-8b55-1a027cf05dcc" released by "delete_volume" :: held 1.083s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Created reservations ['4ad190f7-6878-4a15-a5b9-32bdcffaf8f1', '6828f016-e743-4853-b3ef-433638296af3', '6025a900-b8ba-44df-9be5-260d10837b7c', 'd521c7f9-233e-4b91-8a46-ac84e85609bc'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:45 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:45 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c 1G" returned: 0 in 0.681s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b61664-7eab-41cb-8506-6d65d19dc315 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:45 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b61664-7eab-41cb-8506-6d65d19dc315 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:45 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:46 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Deleted volume successfully. Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bd60b606-1150-4e8e-9337-e171f2e1fe62 tempest-VolumesSnapshotNegativeTestJSON-1309426655 None] Lock "cinder-070b3e71-2b3c-4279-8b55-1a027cf05dcc-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:46 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690" returned: 0 in 0.731s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:46 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690 Apr 14 03:52:46 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:46 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b61664-7eab-41cb-8506-6d65d19dc315 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.530s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:46 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c is being set with open permissions: ugo+rw Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:46 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:46 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:46 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145.f833f1ea-0b9e-4364-b31b-6bc60a01b690" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-f833f1ea-0b9e-4364-b31b-6bc60a01b690" released by "_delete_snapshot" :: held 2.409s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" released by "delete_snapshot" :: held 2.427s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:46 devstack cinder-volume[82370]: WARNING cinder.quota [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1562855262 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1562855262, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:46 devstack cinder-volume[82370]: WARNING cinder.quota [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1562855262 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1562855262, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] Created reservations ['869c9cb2-fcfd-41c0-8f9b-81cef3896e31', '052cb5e6-5427-42ff-a71c-742e986fadce', 'facb6a97-33dc-4f1b-a448-fcfdc65368d9', '8d408376-8e61-4cae-8170-d34e05ab8998'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-46b7f1cc-2f9e-4c92-9e3b-c0a69b071ac4 tempest-GroupSnapshotsTest-824165161 None] group_snapshot 103d7058-cc0c-4e32-a5b9-034e7cadd095: deleted successfully Apr 14 03:52:46 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.577s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:47 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info Apr 14 03:52:47 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:47 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info" returned: 0 in 0.563s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:47 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info is being set with open permissions: ugo+rw Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:47 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info Apr 14 03:52:47 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56787a-fa9e-4cfb-b679-9ea603ecb087]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:47 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 Apr 14 03:52:47 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:48 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.info" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.398s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ecfe3bb1-d67c-4c5f-8455-80ea27b974ec tempest-VolumesDeleteCascade-635874153 None] Create snapshot completed successfully Apr 14 03:52:48 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145" returned: 0 in 0.629s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:48 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145 Apr 14 03:52:48 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (5f91eae6-8cd2-4f18-8ef5-7889735cb5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f605615b-c2b6-4d16-b188-6929ac1ddedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f605615b-c2b6-4d16-b188-6929ac1ddedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071905284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9db3ff-5e51-4af7-9b3a-323a21617dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:49Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9105f12-9864-4523-b4de-a6da5e28c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9105f12-9864-4523-b4de-a6da5e28c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63af4458-bd1b-4018-8e25-cea185bc5de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63af4458-bd1b-4018-8e25-cea185bc5de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9db3ff-5e51-4af7-9b3a-323a21617dd4', 'volume_name': 'volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1c6218-247e-430a-b067-82b6f2fb1a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1c6218-247e-430a-b067-82b6f2fb1a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bd9689-0749-4338-b90b-e2285ae58c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:48 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume 1d9db3ff-5e51-4af7-9b3a-323a21617dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4', 'volume_size': 1} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071905284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9db3ff-5e51-4af7-9b3a-323a21617dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:49Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume 1d9db3ff-5e51-4af7-9b3a-323a21617dd4 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:48 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:48 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 1073741824 Apr 14 03:52:48 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:48 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c3527d75-819e-4bdd-940a-83738d82a145" returned: 0 in 0.521s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Lock "cinder-quobyte-c3527d75-819e-4bdd-940a-83738d82a145" released by "delete_volume" :: held 1.184s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Created reservations ['61addf39-94f1-4a00-bfdf-702704ce94d2'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:49 devstack cinder-volume[82370]: WARNING cinder.quota [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1562855262 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1562855262, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Created reservations ['9e7c8546-8824-4b15-8038-c87ef5c6d900', '77abab9a-e1e9-427b-b912-a94d62306151', 'b58caec9-4e07-4d1d-b589-59cb60815ed6', '2c2cbb74-2c44-4e9f-9ca6-3944dffecb0d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:49 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:49 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:49 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 1073741824" returned: 0 in 0.666s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (99f817bb-9b3c-48ba-8d58-dba93a04815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac141c8-03d3-4481-a3cc-1c04deaf0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac141c8-03d3-4481-a3cc-1c04deaf0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-643359077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf93b27e-a548-411d-8114-3b103bef8ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17921115cab9492f921da6da4ad3507e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=070dd2a9-c2c8-4373-bb26-3a8aae68b96c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:49Z,use_quota=True,user_id='66f9f7afcbe742f1983d39ad18a83b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16775e68-ca26-4d9d-8c07-398cf8246b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16775e68-ca26-4d9d-8c07-398cf8246b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e726d-ac5b-4650-9f77-983a9abf0f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e726d-ac5b-4650-9f77-983a9abf0f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf93b27e-a548-411d-8114-3b103bef8ab6', 'volume_name': 'volume-cf93b27e-a548-411d-8114-3b103bef8ab6', 'volume_size': 1, 'snapshot_id': '070dd2a9-c2c8-4373-bb26-3a8aae68b96c'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8db0a3-c452-4295-be4a-5314916a9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8db0a3-c452-4295-be4a-5314916a9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9282d468-d678-4663-b102-7feccfd766cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Volume cf93b27e-a548-411d-8114-3b103bef8ab6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf93b27e-a548-411d-8114-3b103bef8ab6', 'volume_size': 1, 'snapshot_id': '070dd2a9-c2c8-4373-bb26-3a8aae68b96c'} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:49 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 Apr 14 03:52:49 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:49 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5d1efb1c-1420-4645-adfd-3f1996d2099f tempest-GroupSnapshotsTest-824165161 None] Delete group completed successfully. Apr 14 03:52:49 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.497s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-cf93b27e-a548-411d-8114-3b103bef8ab6" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bd9689-0749-4338-b90b-e2285ae58c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bbd71-3ab5-4287-9974-4a2f180d6724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:49 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 (1d9db3ff-5e51-4af7-9b3a-323a21617dd4): created successfully Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bbd71-3ab5-4287-9974-4a2f180d6724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (5f91eae6-8cd2-4f18-8ef5-7889735cb5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-cf93b27e-a548-411d-8114-3b103bef8ab6" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Creating volume cf93b27e-a548-411d-8114-3b103bef8ab6 from snapshot 070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9c634bb3-497c-4c6f-b679-7506f77e9d83 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] snapshot: 070dd2a9-c2c8-4373-bb26-3a8aae68b96c, volume: cf93b27e-a548-411d-8114-3b103bef8ab6, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e5503b-24b7-4f0b-93c2-50f44df98a09]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:50 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:50 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:50 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.606s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7b61664-7eab-41cb-8506-6d65d19dc315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1e734-e933-4df5-8013-16186c62c79f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:50 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:50 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (60c08ad5-d344-41b5-87c2-0688ca0f4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3759b-c087-4192-b958-a3d7752679f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3759b-c087-4192-b958-a3d7752679f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213432218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d494f6-6b5a-471e-8a16-a2a252de0d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:51Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e43409-3f9a-4415-8525-1918534086c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e43409-3f9a-4415-8525-1918534086c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb1a4bd-0518-4ec4-b105-1c653d1f188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb1a4bd-0518-4ec4-b105-1c653d1f188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d494f6-6b5a-471e-8a16-a2a252de0d4f', 'volume_name': 'volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c13114d-cc07-49a8-92d5-928c0b7514e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c13114d-cc07-49a8-92d5-928c0b7514e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be647f8e-150f-4639-b707-4cce92e1cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume 16d494f6-6b5a-471e-8a16-a2a252de0d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f', 'volume_size': 1} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:51 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.803s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:51 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 Apr 14 03:52:51 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (9ca8ae53-7211-40e3-a943-62debe56a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1339b3ec-3545-4a46-887f-d3b4edc72848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1339b3ec-3545-4a46-887f-d3b4edc72848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829219003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419322f6-ee4e-4d89-8ece-5cbb96ce03f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:51Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79f977f-1fb3-40ff-bac0-23c675aa08c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79f977f-1fb3-40ff-bac0-23c675aa08c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270fc18f-9f0c-45b7-acc2-27f8ceebee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270fc18f-9f0c-45b7-acc2-27f8ceebee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419322f6-ee4e-4d89-8ece-5cbb96ce03f3', 'volume_name': 'volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88665a5-4a29-418a-8c62-cd8871e21e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88665a5-4a29-418a-8c62-cd8871e21e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca33a225-2c97-4e0f-b862-fcaca325b5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume 419322f6-ee4e-4d89-8ece-5cbb96ce03f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3', 'volume_size': 1} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (3bc67ac8-18f5-491c-b7fb-b65b3cfc7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b591047-2cc5-49af-ad2f-dda6b9337bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b591047-2cc5-49af-ad2f-dda6b9337bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101604075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cfedf-3c84-4799-892b-b4a2f81525f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95722d-6380-45e4-8aad-d1c87cc64231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95722d-6380-45e4-8aad-d1c87cc64231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa59d45-dc04-4fa8-b385-4bc24b62a9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa59d45-dc04-4fa8-b385-4bc24b62a9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54cfedf-3c84-4799-892b-b4a2f81525f3', 'volume_name': 'volume-e54cfedf-3c84-4799-892b-b4a2f81525f3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c51a9a-111b-4ac8-9cc3-9014ad533131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c51a9a-111b-4ac8-9cc3-9014ad533131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaab0c4-119b-4a47-8747-fcea427b2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume e54cfedf-3c84-4799-892b-b4a2f81525f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54cfedf-3c84-4799-892b-b4a2f81525f3', 'volume_size': 1} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Flow 'volume_create_manager' (bc9bcf71-93a4-454d-a372-67365c1377fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7728136a-2a89-4bb2-a636-079a7a15809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7728136a-2a89-4bb2-a636-079a7a15809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1578887579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615d699a-b6dd-4298-8b5e-cf2517989f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9a631db6e14107bbd15baa2af65e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='f51a170c213c4490bc7ac4545b0d3045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ad2642-35b4-45c9-a4f4-cfecc7051991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ad2642-35b4-45c9-a4f4-cfecc7051991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0858b8e5-14a8-42a3-9f37-2494283edd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0858b8e5-14a8-42a3-9f37-2494283edd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615d699a-b6dd-4298-8b5e-cf2517989f8e', 'volume_name': 'volume-615d699a-b6dd-4298-8b5e-cf2517989f8e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df222615-0304-4830-86a0-1652c5fb6353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df222615-0304-4830-86a0-1652c5fb6353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f847bc-0668-48eb-b9e4-11c7c271bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Volume 615d699a-b6dd-4298-8b5e-cf2517989f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615d699a-b6dd-4298-8b5e-cf2517989f8e', 'volume_size': 1} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (8d0ede95-0cd6-4d3e-ac11-009c98db82f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eb4e3c-3a2c-4514-9a3c-9073959b5d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eb4e3c-3a2c-4514-9a3c-9073959b5d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504010430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d384ce-a8df-438c-b845-a8a06a529483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85949c-12f8-4437-8755-03984feb7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85949c-12f8-4437-8755-03984feb7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183b96d4-bf49-4705-8609-99b0589a5f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183b96d4-bf49-4705-8609-99b0589a5f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d384ce-a8df-438c-b845-a8a06a529483', 'volume_name': 'volume-c9d384ce-a8df-438c-b845-a8a06a529483', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55c79b-dbc5-4cc6-ab08-ac738427943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55c79b-dbc5-4cc6-ab08-ac738427943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd53809-58b9-4b2a-9733-a8e6986f3068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume c9d384ce-a8df-438c-b845-a8a06a529483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d384ce-a8df-438c-b845-a8a06a529483', 'volume_size': 1} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (0662ee09-1c05-45af-9035-cf38b78e0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143a2fad-d24b-4b39-a0c6-a4ad49f60b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143a2fad-d24b-4b39-a0c6-a4ad49f60b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095457047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dac6c6-fa03-46a1-966d-6fc42a729006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665d9466-1e46-4205-9f81-0ad715b72275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665d9466-1e46-4205-9f81-0ad715b72275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad11aacd-9591-4ac4-b638-bfe8e3e81b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad11aacd-9591-4ac4-b638-bfe8e3e81b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64dac6c6-fa03-46a1-966d-6fc42a729006', 'volume_name': 'volume-64dac6c6-fa03-46a1-966d-6fc42a729006', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc08885f-ea7a-4c8e-9198-82ec03e01067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc08885f-ea7a-4c8e-9198-82ec03e01067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a195f2f-99a3-4e8a-8adc-1ee8de2ba0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:52 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume 64dac6c6-fa03-46a1-966d-6fc42a729006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64dac6c6-fa03-46a1-966d-6fc42a729006', 'volume_size': 1} Apr 14 03:52:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:53 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6" returned: 0 in 2.611s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836dab4-868a-4ed6-bda3-c44b78de723f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:54 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:54 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:54 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.619s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:54 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315, size 1024.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:52:54 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Converted 1024.00 MB image at 392.11 MB/s Apr 14 03:52:54 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 is being set with open permissions: ugo+rw Apr 14 03:52:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:54 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 Apr 14 03:52:54 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:55 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" released by "_copy_volume_from_snapshot" :: held 5.112s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-cf93b27e-a548-411d-8114-3b103bef8ab6" released by "_create_volume_from_snapshot" :: held 5.138s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.173s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.681s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213432218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d494f6-6b5a-471e-8a16-a2a252de0d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:51Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume 16d494f6-6b5a-471e-8a16-a2a252de0d4f {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:55 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:55 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f 1073741824 Apr 14 03:52:55 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9282d468-d678-4663-b102-7feccfd766cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf93b27e-a548-411d-8114-3b103bef8ab6', 'volume_size': 1, 'snapshot_id': '070dd2a9-c2c8-4373-bb26-3a8aae68b96c'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1367b3-fd78-4da3-9601-f9e9e910c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:55 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Volume volume-cf93b27e-a548-411d-8114-3b103bef8ab6 (cf93b27e-a548-411d-8114-3b103bef8ab6): created successfully Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1367b3-fd78-4da3-9601-f9e9e910c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Flow 'volume_create_manager' (99f817bb-9b3c-48ba-8d58-dba93a04815e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:55 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8744b686-c75a-4ed0-ab9f-45a0350eebbd tempest-VolumesDeleteCascade-635874153 None] Created volume successfully. Apr 14 03:52:55 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f 1073741824" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:55 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f Apr 14 03:52:55 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:56 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.528s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829219003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419322f6-ee4e-4d89-8ece-5cbb96ce03f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:51Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume 419322f6-ee4e-4d89-8ece-5cbb96ce03f3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:56 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-a7b61664-7eab-41cb-8506-6d65d19dc315-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:56 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 1073741824 Apr 14 03:52:56 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be647f8e-150f-4639-b707-4cce92e1cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cad56e7-c280-454e-b2ab-04bed04fbb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:56 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f (16d494f6-6b5a-471e-8a16-a2a252de0d4f): created successfully Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cad56e7-c280-454e-b2ab-04bed04fbb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (60c08ad5-d344-41b5-87c2-0688ca0f4128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-a7b61664-7eab-41cb-8506-6d65d19dc315-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:56 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bf21f879-4d94-4a86-8c17-69fcd6d43a31 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Performing cascade delete. {{(pid=82370) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Deleting offline snapshot 070dd2a9-c2c8-4373-bb26-3a8aae68b96c of volume a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] snapshot_file for this snap is: volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7dbdeb-f227-4980-8bde-0fc9dc9ec728]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:56 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:56 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:56 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 1073741824" returned: 0 in 0.642s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:56 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 Apr 14 03:52:56 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:56 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.586s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7b61664-7eab-41cb-8506-6d65d19dc315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d8a15-6ba5-457d-b14e-414c0452c5f6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:56 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:56 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:57 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" returned: 0 in 0.504s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.419s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101604075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54cfedf-3c84-4799-892b-b4a2f81525f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume e54cfedf-3c84-4799-892b-b4a2f81525f3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:57 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca33a225-2c97-4e0f-b862-fcaca325b5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdf4cd0-073f-4df4-81db-dc3c41f9718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:57 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 1073741824 Apr 14 03:52:57 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:57 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 (419322f6-ee4e-4d89-8ece-5cbb96ce03f3): created successfully Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdf4cd0-073f-4df4-81db-dc3c41f9718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (9ca8ae53-7211-40e3-a943-62debe56a42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a211e321-d2fd-4991-8dd1-b10046d26f90 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:52:57 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.535s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:57 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:57 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:57 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 1073741824" returned: 0 in 0.568s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:57 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 Apr 14 03:52:57 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:57 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:57 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c Apr 14 03:52:57 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:58 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.415s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1578887579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615d699a-b6dd-4298-8b5e-cf2517989f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9a631db6e14107bbd15baa2af65e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='f51a170c213c4490bc7ac4545b0d3045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Creating volume 615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:58 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:58 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaab0c4-119b-4a47-8747-fcea427b2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54cfedf-3c84-4799-892b-b4a2f81525f3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f705181c-76f8-4eff-b755-822536179538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315.070dd2a9-c2c8-4373-bb26-3a8aae68b96c" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:58 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e 1073741824 Apr 14 03:52:58 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-070dd2a9-c2c8-4373-bb26-3a8aae68b96c" released by "_delete_snapshot" :: held 2.200s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" released by "delete_snapshot" :: held 2.212s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:58 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 (e54cfedf-3c84-4799-892b-b4a2f81525f3): created successfully Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f705181c-76f8-4eff-b755-822536179538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (3bc67ac8-18f5-491c-b7fb-b65b3cfc7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f8d0e9fe-0c07-47a0-9a6e-6c1300a16d94 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Created reservations ['454b7b72-738e-4488-bf83-54c0a0bba21e', '9f61394f-ea3b-4e80-afa3-2f31f8234b9b', '5b12d53d-af78-425e-b4cc-b4a6b96a5589', '8b439165-c2bc-43f1-a807-170e3f2c5819'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Delete snapshot completed successfully. Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-070dd2a9-c2c8-4373-bb26-3a8aae68b96c-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Snapshots deleted, issuing volume delete {{(pid=82370) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f2900-b54b-4b30-a014-c9d4f67a1144]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:58 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:58 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Flow 'volume_create_manager' (411b4a78-c52b-41fa-ba99-8d6ee4281d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e458f728-51bc-4acd-b645-b356b73e2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e458f728-51bc-4acd-b645-b356b73e2baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1108178613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd32d46-be29-452c-9a9e-e42f558128a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c765028fd42446e98a7de11758a3dd2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:59Z,use_quota=True,user_id='0c2f777558dd4cc0a22a970dd3249ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4f9f63-0c55-43be-a0db-613465700965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4f9f63-0c55-43be-a0db-613465700965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a501001-0751-409e-9221-71f585e4436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a501001-0751-409e-9221-71f585e4436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd32d46-be29-452c-9a9e-e42f558128a2', 'volume_name': 'volume-ccd32d46-be29-452c-9a9e-e42f558128a2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8c47a0-c6ce-4f67-a574-b7d5cdd1a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8c47a0-c6ce-4f67-a574-b7d5cdd1a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656c2b62-6b46-424e-ba0a-bd7053a5a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:58 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Volume ccd32d46-be29-452c-9a9e-e42f558128a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd32d46-be29-452c-9a9e-e42f558128a2', 'volume_size': 1} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:58 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e 1073741824" returned: 0 in 0.562s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:58 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:58 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:58 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:52:58 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:59 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.563s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:59 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315 Apr 14 03:52:59 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:59 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.401s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.300s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-504010430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d384ce-a8df-438c-b845-a8a06a529483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume c9d384ce-a8df-438c-b845-a8a06a529483 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:52:59 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f847bc-0668-48eb-b9e4-11c7c271bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615d699a-b6dd-4298-8b5e-cf2517989f8e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:59 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 1073741824 Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c866053d-67ab-4ed9-8e8a-158c8d54ec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:52:59 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:59 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.463s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:59 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Volume volume-615d699a-b6dd-4298-8b5e-cf2517989f8e (615d699a-b6dd-4298-8b5e-cf2517989f8e): created successfully Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c866053d-67ab-4ed9-8e8a-158c8d54ec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Flow 'volume_create_manager' (bc9bcf71-93a4-454d-a372-67365c1377fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:52:59 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-98d44aa7-5d87-441d-a783-9ecb81c46faf tempest-VolumesActionsTest-338693723 None] Created volume successfully. Apr 14 03:52:59 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a7b61664-7eab-41cb-8506-6d65d19dc315" returned: 0 in 0.402s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-a7b61664-7eab-41cb-8506-6d65d19dc315" released by "delete_volume" :: held 0.992s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Created reservations ['6068fd41-32c9-4771-be5f-c5e1fee2c726', 'f8b49a19-b3d1-4597-9177-a238af781ef2', 'ae3e6271-0989-4cd7-bc66-0a16a471b628', '17622b61-1188-48f7-8a94-3b12f0aadd89'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:59 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:52:59 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:59 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 1073741824" returned: 0 in 0.524s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:52:59 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 Apr 14 03:52:59 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:52:59 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:52:59 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Deleted volume successfully. Apr 14 03:52:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-afa40711-42ce-4307-979d-2cf266a20668 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-a7b61664-7eab-41cb-8506-6d65d19dc315-delete_volume" released by "delete_volume" :: held 3.866s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:00 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483" returned: 0 in 0.432s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.712s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095457047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dac6c6-fa03-46a1-966d-6fc42a729006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dcf7a4c61346e6a80f3ee51bfde581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:52Z,use_quota=True,user_id='9895119a3aff43fda00300d1e18cbcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Creating volume 64dac6c6-fa03-46a1-966d-6fc42a729006 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:00 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd53809-58b9-4b2a-9733-a8e6986f3068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d384ce-a8df-438c-b845-a8a06a529483', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:00 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 1073741824 Apr 14 03:53:00 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36d09cd-d9cb-4236-a4e3-5fbb488d3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-c9d384ce-a8df-438c-b845-a8a06a529483 (c9d384ce-a8df-438c-b845-a8a06a529483): created successfully Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36d09cd-d9cb-4236-a4e3-5fbb488d3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (8d0ede95-0cd6-4d3e-ac11-009c98db82f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0e4fe169-8b10-464b-967a-7b515031a57b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-cf93b27e-a548-411d-8114-3b103bef8ab6-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-cf93b27e-a548-411d-8114-3b103bef8ab6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020942a-ca15-4670-a6f5-ca7a3f5a6ed6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:00 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 Apr 14 03:53:00 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:00 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 1073741824" returned: 0 in 0.571s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:00 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 Apr 14 03:53:00 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:01 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:01 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6 Apr 14 03:53:01 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:01 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006" returned: 0 in 0.456s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1108178613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd32d46-be29-452c-9a9e-e42f558128a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c765028fd42446e98a7de11758a3dd2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:52:59Z,use_quota=True,user_id='0c2f777558dd4cc0a22a970dd3249ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Creating volume ccd32d46-be29-452c-9a9e-e42f558128a2 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:01 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a195f2f-99a3-4e8a-8adc-1ee8de2ba0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dac6c6-fa03-46a1-966d-6fc42a729006', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e8adb3-1073-487f-862c-e96e4f41312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:01 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 1073741824 Apr 14 03:53:01 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Volume volume-64dac6c6-fa03-46a1-966d-6fc42a729006 (64dac6c6-fa03-46a1-966d-6fc42a729006): created successfully Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e8adb3-1073-487f-862c-e96e4f41312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Flow 'volume_create_manager' (0662ee09-1c05-45af-9035-cf38b78e0995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d58594f4-8ef8-4e2c-a345-918403b6d87f tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created volume successfully. Apr 14 03:53:01 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf93b27e-a548-411d-8114-3b103bef8ab6" returned: 0 in 0.465s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-quobyte-cf93b27e-a548-411d-8114-3b103bef8ab6" released by "delete_volume" :: held 1.107s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Created reservations ['1b512659-4d1b-49d2-b06a-d592605fb951', '11893dc8-bca6-4ee7-8bf7-5e5d9d16b726', '595d16a6-41db-4a93-8eec-269cdee96d3d', 'cc127257-838d-4eaf-b973-8aa5cd5c1c51'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:01 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:01 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-64dac6c6-fa03-46a1-966d-6fc42a729006-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-64dac6c6-fa03-46a1-966d-6fc42a729006-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-64dac6c6-fa03-46a1-966d-6fc42a729006" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-64dac6c6-fa03-46a1-966d-6fc42a729006" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5830c5e-6d90-4b97-bb6e-0c4114cf4312]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:01 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 1073741824" returned: 0 in 0.607s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:02 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 Apr 14 03:53:02 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:02 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 Apr 14 03:53:02 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:02 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Deleted volume successfully. Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1c5bc16b-36f0-4ccd-826d-f54e5ae80248 tempest-VolumesDeleteCascade-635874153 None] Lock "cinder-cf93b27e-a548-411d-8114-3b103bef8ab6-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:02 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2" returned: 0 in 0.449s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656c2b62-6b46-424e-ba0a-bd7053a5a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd32d46-be29-452c-9a9e-e42f558128a2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c293c97-60e3-45ab-8120-fc00650cdfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:02 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:02 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Volume volume-ccd32d46-be29-452c-9a9e-e42f558128a2 (ccd32d46-be29-452c-9a9e-e42f558128a2): created successfully Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c293c97-60e3-45ab-8120-fc00650cdfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:02 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006 Apr 14 03:53:02 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Flow 'volume_create_manager' (411b4a78-c52b-41fa-ba99-8d6ee4281d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-540d5ffd-276f-4cca-9be1-19f7fd1b4058 tempest-VolumesServicesTestJSON-1209986762 None] Created volume successfully. Apr 14 03:53:02 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64dac6c6-fa03-46a1-966d-6fc42a729006" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-64dac6c6-fa03-46a1-966d-6fc42a729006" released by "delete_volume" :: held 1.015s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['3ffd96b5-c1ef-4297-8bd1-d619c08df272', '6528029b-f283-4f3e-a4d9-5c3bb8cdaa0b', 'b8a6533b-ecc2-4228-a9fb-1b1e03973110', '0ab52143-5f1b-4311-a846-66a1f9ee29fc'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:03 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:03 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Acquiring lock "cinder-ccd32d46-be29-452c-9a9e-e42f558128a2-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "cinder-ccd32d46-be29-452c-9a9e-e42f558128a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Acquiring lock "cinder-quobyte-ccd32d46-be29-452c-9a9e-e42f558128a2" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "cinder-quobyte-ccd32d46-be29-452c-9a9e-e42f558128a2" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c7b3d5-faa3-4da5-9e19-820766612a05]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:03 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 Apr 14 03:53:03 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:03 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-013468fd-5564-4c0c-810d-cdb694e28b4c tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-64dac6c6-fa03-46a1-966d-6fc42a729006-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:03 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:03 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2 Apr 14 03:53:03 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-c9d384ce-a8df-438c-b845-a8a06a529483-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-c9d384ce-a8df-438c-b845-a8a06a529483-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-c9d384ce-a8df-438c-b845-a8a06a529483" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-c9d384ce-a8df-438c-b845-a8a06a529483" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5298429a-ff26-4252-a6ca-4a6bed7039f4]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:04 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 Apr 14 03:53:04 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:04 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccd32d46-be29-452c-9a9e-e42f558128a2" returned: 0 in 0.500s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "cinder-quobyte-ccd32d46-be29-452c-9a9e-e42f558128a2" released by "delete_volume" :: held 1.130s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Created reservations ['820a2b5c-6978-4bf2-839f-d37e77bc8935', 'acdfab05-3ee8-45a9-9034-d2b4b7753de8', '52811f63-bc33-4f2f-ad75-08a34dc7f5a2', '6c37b53c-74d2-4054-8bc0-606bf01f8533'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:04 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:04 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Flow 'volume_create_manager' (7ffe2699-9245-40f6-af45-9c7e5d80fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d217711-2152-4dee-b868-eb0c96cf164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d217711-2152-4dee-b868-eb0c96cf164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1611588582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549c3e92-8578-4a30-8970-d96b1f303bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5de1456969f45bd83059d04f213a2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:04Z,use_quota=True,user_id='e4d77afec7e044f196812d6cebe57921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11606e2-d5ad-4080-8f03-9c9c3c86f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11606e2-d5ad-4080-8f03-9c9c3c86f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582a894-1dd7-4e23-a11d-5db41f62feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582a894-1dd7-4e23-a11d-5db41f62feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549c3e92-8578-4a30-8970-d96b1f303bfb', 'volume_name': 'volume-549c3e92-8578-4a30-8970-d96b1f303bfb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4993a042-ee85-4874-a317-662c42ada4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4993a042-ee85-4874-a317-662c42ada4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661b3c4b-5386-4d2f-afc2-ff6decde5f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:04 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Volume 549c3e92-8578-4a30-8970-d96b1f303bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549c3e92-8578-4a30-8970-d96b1f303bfb', 'volume_size': 1} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1611588582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549c3e92-8578-4a30-8970-d96b1f303bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5de1456969f45bd83059d04f213a2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:04Z,use_quota=True,user_id='e4d77afec7e044f196812d6cebe57921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Creating volume 549c3e92-8578-4a30-8970-d96b1f303bfb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:04 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:04 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb 1073741824 Apr 14 03:53:04 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:04 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483" returned: 0 in 0.569s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:04 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483 Apr 14 03:53:04 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:04 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Deleted volume successfully. Apr 14 03:53:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81127113-b7b7-475c-97d5-bc06e62fe9fb tempest-VolumesServicesTestJSON-1209986762 None] Lock "cinder-ccd32d46-be29-452c-9a9e-e42f558128a2-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:05 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb 1073741824" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:05 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb Apr 14 03:53:05 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:05 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c9d384ce-a8df-438c-b845-a8a06a529483" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-c9d384ce-a8df-438c-b845-a8a06a529483" released by "delete_volume" :: held 1.029s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['9f9205bc-bdf5-40ee-ba23-7ab4f11da615', '4fca8bbf-f6a8-40a4-b24a-9303173c5f3d', '23456240-a745-41ef-9c8a-9cd7acda03f4', 'e586d957-7144-44cd-9b80-ace360e9529d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:05 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:05 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:05 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb" returned: 0 in 0.600s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661b3c4b-5386-4d2f-afc2-ff6decde5f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549c3e92-8578-4a30-8970-d96b1f303bfb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bfab13-5636-46c2-bd3e-8f87735322ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:05 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Volume volume-549c3e92-8578-4a30-8970-d96b1f303bfb (549c3e92-8578-4a30-8970-d96b1f303bfb): created successfully Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bfab13-5636-46c2-bd3e-8f87735322ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Flow 'volume_create_manager' (7ffe2699-9245-40f6-af45-9c7e5d80fb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2f942571-6077-46fb-b341-0e50840ce6c6 tempest-VolumesMetadataTest-1068792789 None] Created volume successfully. Apr 14 03:53:05 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-42eafb8c-ed25-42cf-82a4-a75920b89ed5 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-c9d384ce-a8df-438c-b845-a8a06a529483-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-e54cfedf-3c84-4799-892b-b4a2f81525f3-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-e54cfedf-3c84-4799-892b-b4a2f81525f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-e54cfedf-3c84-4799-892b-b4a2f81525f3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-e54cfedf-3c84-4799-892b-b4a2f81525f3" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[37422c61-3ccb-4605-ace3-36cdcda60166]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:06 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 Apr 14 03:53:06 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:06 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3" returned: 0 in 0.625s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:07 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3 Apr 14 03:53:07 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Acquiring lock "cinder-549c3e92-8578-4a30-8970-d96b1f303bfb-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "cinder-549c3e92-8578-4a30-8970-d96b1f303bfb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Acquiring lock "cinder-quobyte-549c3e92-8578-4a30-8970-d96b1f303bfb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "cinder-quobyte-549c3e92-8578-4a30-8970-d96b1f303bfb" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dabfd0-de48-4e9b-9968-542b9a5c3459]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:07 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb Apr 14 03:53:07 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:07 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e54cfedf-3c84-4799-892b-b4a2f81525f3" returned: 0 in 0.558s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-e54cfedf-3c84-4799-892b-b4a2f81525f3" released by "delete_volume" :: held 1.211s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['133716a9-5495-4ef8-9959-87a410d5a6a4', '901ca259-c805-4e10-af3b-e4b741ed8236', '14f23aae-d636-4bfd-8bc4-4bfa0465b372', '20f99cde-a935-4d30-99c1-1544fb5cc7b8'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:07 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:07 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:07 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb" returned: 0 in 0.639s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:07 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb Apr 14 03:53:07 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:08 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.534s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3fec6cb5-01d6-445c-84ba-a9f1d266991b tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-e54cfedf-3c84-4799-892b-b4a2f81525f3-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:08 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-549c3e92-8578-4a30-8970-d96b1f303bfb" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "cinder-quobyte-549c3e92-8578-4a30-8970-d96b1f303bfb" released by "delete_volume" :: held 1.189s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Created reservations ['c034b328-ad79-4930-a91f-d5e876a613df', 'a767fa5e-900d-481b-b9a7-08b84f321496', '539d4f0c-2900-40f8-9f3a-bf8846857d42', 'fcf44e51-d5bc-4387-abd1-63def5713b70'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:08 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:08 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-419322f6-ee4e-4d89-8ece-5cbb96ce03f3-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-419322f6-ee4e-4d89-8ece-5cbb96ce03f3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fb601-7832-46ce-bc4d-4002de2f0c3e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:08 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 Apr 14 03:53:08 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:08 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Deleted volume successfully. Apr 14 03:53:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-54df2514-84b4-48ac-bf07-207992f62b56 tempest-VolumesMetadataTest-1068792789 None] Lock "cinder-549c3e92-8578-4a30-8970-d96b1f303bfb-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Flow 'volume_create_manager' (45ed6082-2dbb-479d-9bce-26e4b9aef65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac00f3bf-098e-4fa1-a009-2e5412aedba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac00f3bf-098e-4fa1-a009-2e5412aedba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-167040916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83decaa4-0543-420a-855b-3cd365ad0fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50864c40a1a44d9ac133ed0798300a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:09Z,use_quota=True,user_id='64b6ac29ebed45c6840a019481999470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4924fdac-5a53-4e2e-a180-1226a26fa7ab),volume_type_id=4924fdac-5a53-4e2e-a180-1226a26fa7ab)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0216dd-698c-42ab-88fd-57e641e695d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0216dd-698c-42ab-88fd-57e641e695d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:09 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466da920-33a9-476c-99ce-8d9208dfacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466da920-33a9-476c-99ce-8d9208dfacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83decaa4-0543-420a-855b-3cd365ad0fd7', 'volume_name': 'volume-83decaa4-0543-420a-855b-3cd365ad0fd7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ebdfb2-cf4c-4e5b-b317-8bb44a903dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ebdfb2-cf4c-4e5b-b317-8bb44a903dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d52a77-00bd-4c19-a8af-e0c007afeaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:09 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Volume 83decaa4-0543-420a-855b-3cd365ad0fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83decaa4-0543-420a-855b-3cd365ad0fd7', 'volume_size': 1} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-167040916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83decaa4-0543-420a-855b-3cd365ad0fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50864c40a1a44d9ac133ed0798300a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:09Z,use_quota=True,user_id='64b6ac29ebed45c6840a019481999470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4924fdac-5a53-4e2e-a180-1226a26fa7ab),volume_type_id=4924fdac-5a53-4e2e-a180-1226a26fa7ab)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Creating volume 83decaa4-0543-420a-855b-3cd365ad0fd7 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:09 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" returned: 0 in 0.620s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:09 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 1073741824 Apr 14 03:53:09 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:09 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3 Apr 14 03:53:09 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:09 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-419322f6-ee4e-4d89-8ece-5cbb96ce03f3" released by "delete_volume" :: held 1.126s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['fa9ab36b-b225-4225-89ec-db9c033f3331', 'b366beba-5dc2-4c1a-a851-14de95abf5e0', '5a6adf48-309c-441d-95e0-746efea32706', 'fb3d565b-d1f1-4b77-83d9-325e100295de'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:09 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:09 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:09 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 1073741824" returned: 0 in 0.620s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:09 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 Apr 14 03:53:09 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:10 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a30bc189-9528-4d31-84c1-985378a7c079 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-419322f6-ee4e-4d89-8ece-5cbb96ce03f3-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:10 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d52a77-00bd-4c19-a8af-e0c007afeaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83decaa4-0543-420a-855b-3cd365ad0fd7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd0d2db-453f-4fa2-ab0c-2924b8f18993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Volume volume-83decaa4-0543-420a-855b-3cd365ad0fd7 (83decaa4-0543-420a-855b-3cd365ad0fd7): created successfully Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd0d2db-453f-4fa2-ab0c-2924b8f18993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Flow 'volume_create_manager' (45ed6082-2dbb-479d-9bce-26e4b9aef65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e95e4f93-3713-44ab-aecb-f48bc965b8d2 tempest-VolumeTypesAccessTest-606611996 None] Created volume successfully. Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-16d494f6-6b5a-471e-8a16-a2a252de0d4f-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-16d494f6-6b5a-471e-8a16-a2a252de0d4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-16d494f6-6b5a-471e-8a16-a2a252de0d4f" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-16d494f6-6b5a-471e-8a16-a2a252de0d4f" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03c896-68b2-4075-86de-abe22d7cdabf]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:10 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f Apr 14 03:53:10 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Flow 'volume_create_manager' (42495f3e-b379-48e4-b537-344e1574cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51cb0a9-cd38-4a96-a406-b92d3a2e0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51cb0a9-cd38-4a96-a406-b92d3a2e0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1010097412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b0f687-50a6-4d4f-8835-08f057399a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdf419384ad404289528b19a811f26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:11Z,use_quota=True,user_id='a26038e5e1e844f19785bccd6080fe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca7b181-2133-4a79-b8a4-f1a7c9225f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca7b181-2133-4a79-b8a4-f1a7c9225f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22a454c-930c-4d90-b40c-f34dd87376a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22a454c-930c-4d90-b40c-f34dd87376a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b0f687-50a6-4d4f-8835-08f057399a0d', 'volume_name': 'volume-90b0f687-50a6-4d4f-8835-08f057399a0d', 'volume_size': 2}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e41815-283b-45b2-a16e-81b07609c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e41815-283b-45b2-a16e-81b07609c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0331c110-c025-43c7-97f6-42c0aefca8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Volume 90b0f687-50a6-4d4f-8835-08f057399a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b0f687-50a6-4d4f-8835-08f057399a0d', 'volume_size': 2} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1010097412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b0f687-50a6-4d4f-8835-08f057399a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdf419384ad404289528b19a811f26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:11Z,use_quota=True,user_id='a26038e5e1e844f19785bccd6080fe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Creating volume 90b0f687-50a6-4d4f-8835-08f057399a0d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:11 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d 2147483648 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d 2147483648 Apr 14 03:53:11 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Acquiring lock "cinder-83decaa4-0543-420a-855b-3cd365ad0fd7-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "cinder-83decaa4-0543-420a-855b-3cd365ad0fd7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Acquiring lock "cinder-quobyte-83decaa4-0543-420a-855b-3cd365ad0fd7" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:11 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "cinder-quobyte-83decaa4-0543-420a-855b-3cd365ad0fd7" acquired by "delete_volume" :: waited 0.024s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228e452-697a-4345-94da-5bcbbe56b8b2]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:11 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f Apr 14 03:53:11 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 Apr 14 03:53:11 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-16d494f6-6b5a-471e-8a16-a2a252de0d4f" returned: 0 in 0.429s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-16d494f6-6b5a-471e-8a16-a2a252de0d4f" released by "delete_volume" :: held 0.987s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:11 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d 2147483648" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d Apr 14 03:53:11 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['5e9355d8-518e-497d-8409-840fee983ca2', 'adfc7c9e-11fa-4bae-aad1-e5bef8d2e6b2', '86983df1-9541-4d7e-bc7d-774d95ffc51e', 'a7f95ef3-8f0e-4689-99f0-a1899bea1d09'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7" returned: 0 in 0.545s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:11 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:11 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:11 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7 Apr 14 03:53:11 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:12 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0331c110-c025-43c7-97f6-42c0aefca8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b0f687-50a6-4d4f-8835-08f057399a0d', 'volume_size': 2}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafbe411-30e2-41fc-8e2e-e15805aa2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:12 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Volume volume-90b0f687-50a6-4d4f-8835-08f057399a0d (90b0f687-50a6-4d4f-8835-08f057399a0d): created successfully Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafbe411-30e2-41fc-8e2e-e15805aa2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Flow 'volume_create_manager' (42495f3e-b379-48e4-b537-344e1574cd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8745b12c-e4cd-4a68-8259-7d6c661aeb5a tempest-VolumesCloneNegativeTest-647961747 None] Created volume successfully. Apr 14 03:53:12 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-83decaa4-0543-420a-855b-3cd365ad0fd7" returned: 0 in 0.570s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:12 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "cinder-quobyte-83decaa4-0543-420a-855b-3cd365ad0fd7" released by "delete_volume" :: held 1.153s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.619s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0a33af75-3e6e-4c12-bfd2-2c9cf6510254 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-16d494f6-6b5a-471e-8a16-a2a252de0d4f-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:12 devstack cinder-volume[82370]: WARNING cinder.quota [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-914359992 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-914359992, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:53:12 devstack cinder-volume[82370]: WARNING cinder.quota [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-914359992 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-914359992, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Created reservations ['4d009506-071d-4d4e-9397-eef55212ca9d', 'bed96e78-9f0d-46f5-aad1-c808621d9511', 'ab78c73b-045a-4228-a583-7866fb0078ef', '14e39b75-d861-4525-9cc9-88e4d8b259cc'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:12 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:12 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-1d9db3ff-5e51-4af7-9b3a-323a21617dd4-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-1d9db3ff-5e51-4af7-9b3a-323a21617dd4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "cinder-quobyte-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef241f-87a2-4f11-a024-076bf008580a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:13 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 Apr 14 03:53:13 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:13 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Deleted volume successfully. Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-758e188c-90f7-4780-8c60-a883d0bac254 tempest-VolumeTypesAccessTest-606611996 None] Lock "cinder-83decaa4-0543-420a-855b-3cd365ad0fd7-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Acquiring lock "cinder-90b0f687-50a6-4d4f-8835-08f057399a0d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "cinder-90b0f687-50a6-4d4f-8835-08f057399a0d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Acquiring lock "cinder-quobyte-90b0f687-50a6-4d4f-8835-08f057399a0d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "cinder-quobyte-90b0f687-50a6-4d4f-8835-08f057399a0d" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[63523e3a-143b-4edf-b631-f79798658553]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:13 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d Apr 14 03:53:13 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:13 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" returned: 0 in 0.704s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:13 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4 Apr 14 03:53:13 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:14 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d" returned: 0 in 0.633s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:14 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d Apr 14 03:53:14 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:14 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" returned: 0 in 0.617s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-quobyte-1d9db3ff-5e51-4af7-9b3a-323a21617dd4" released by "delete_volume" :: held 1.350s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Created reservations ['37c5d0cb-b713-488b-802a-ce146b331be9', '9ae00654-30f3-48d8-8f2e-a221d0f4cdba', 'd7ba98f9-ff84-49d3-b5f3-ef46ae3a13d3', '8a745d02-3bd5-4525-9f16-08ccf3a29132'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:14 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:14 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-926a8821-1964-404f-acb0-10153d52cb82 tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" by "attach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-926a8821-1964-404f-acb0-10153d52cb82 tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" acquired by "attach_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:14 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-90b0f687-50a6-4d4f-8835-08f057399a0d" returned: 0 in 0.591s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "cinder-quobyte-90b0f687-50a6-4d4f-8835-08f057399a0d" released by "delete_volume" :: held 1.264s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Created reservations ['cf4ce57a-dfeb-4f5e-9d39-bdf49b9e5ac6', 'b6d2b054-a10b-40d1-af3c-50aa42f27fdb', '74899bd4-8908-41c7-8b69-801df8a95c12', '6e84a9b3-597c-4d24-b9d8-62e35c80d7cc'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-926a8821-1964-404f-acb0-10153d52cb82 tempest-VolumesActionsTest-338693723 None] Attaching volume 615d699a-b6dd-4298-8b5e-cf2517989f8e to instance 94334456-06bc-46e7-aadf-9f15cdf0eb71 at mountpoint /dev/vdb on host None. Apr 14 03:53:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-926a8821-1964-404f-acb0-10153d52cb82 tempest-VolumesActionsTest-338693723 None] Attach volume completed successfully. Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-926a8821-1964-404f-acb0-10153d52cb82 tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" released by "attach_volume" :: held 0.215s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:14 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:14 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:15 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.643s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Deleted volume successfully. Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-484dda35-77d0-4cdf-9d51-ab352ef40227 tempest-CreateVolumesFromSourceVolumeTest-1824609235 None] Lock "cinder-1d9db3ff-5e51-4af7-9b3a-323a21617dd4-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aa030b01-601f-4b7d-81b2-0627f3528d6d tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" by "detach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aa030b01-601f-4b7d-81b2-0627f3528d6d tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-aa030b01-601f-4b7d-81b2-0627f3528d6d tempest-VolumesActionsTest-338693723 None] Detaching volume 615d699a-b6dd-4298-8b5e-cf2517989f8e from instance 94334456-06bc-46e7-aadf-9f15cdf0eb71. Apr 14 03:53:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-aa030b01-601f-4b7d-81b2-0627f3528d6d tempest-VolumesActionsTest-338693723 None] Detach volume completed successfully. Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aa030b01-601f-4b7d-81b2-0627f3528d6d tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:15 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.614s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Deleted volume successfully. Apr 14 03:53:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7a42869f-a57b-4c38-9b95-e70569423b57 tempest-VolumesCloneNegativeTest-647961747 None] Lock "cinder-90b0f687-50a6-4d4f-8835-08f057399a0d-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Flow 'volume_create_manager' (9276071c-db71-41c1-8357-7201e14481f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460fa30f-1726-4251-8cca-bd4a7698a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460fa30f-1726-4251-8cca-bd4a7698a901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1088570243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c145b6-7b12-4330-ac78-253d7714962e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b10f2f61e44cd98265d586823b79c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:19Z,use_quota=True,user_id='57b70b82e75f4892baef18af90dc5f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef9a5c-cf07-41d2-bcf0-ba1952291e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef9a5c-cf07-41d2-bcf0-ba1952291e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef51e35-f8c0-46e8-bb80-00f6c799d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef51e35-f8c0-46e8-bb80-00f6c799d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c145b6-7b12-4330-ac78-253d7714962e', 'volume_name': 'volume-a2c145b6-7b12-4330-ac78-253d7714962e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e200b91c-fda7-41f2-a37b-53730b749294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e200b91c-fda7-41f2-a37b-53730b749294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdae03d0-b281-489a-b145-1edeec34f8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:19 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Volume a2c145b6-7b12-4330-ac78-253d7714962e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c145b6-7b12-4330-ac78-253d7714962e', 'volume_size': 1} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1088570243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c145b6-7b12-4330-ac78-253d7714962e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b10f2f61e44cd98265d586823b79c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:19Z,use_quota=True,user_id='57b70b82e75f4892baef18af90dc5f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Creating volume a2c145b6-7b12-4330-ac78-253d7714962e {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:19 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:19 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e 1073741824 Apr 14 03:53:19 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:19 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e 1073741824" returned: 0 in 0.644s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:19 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e Apr 14 03:53:19 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:20 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e" returned: 0 in 0.542s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdae03d0-b281-489a-b145-1edeec34f8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c145b6-7b12-4330-ac78-253d7714962e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcb6293-d83b-477d-aeff-4391f2f2850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:20 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Volume volume-a2c145b6-7b12-4330-ac78-253d7714962e (a2c145b6-7b12-4330-ac78-253d7714962e): created successfully Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcb6293-d83b-477d-aeff-4391f2f2850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Flow 'volume_create_manager' (9276071c-db71-41c1-8357-7201e14481f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-66f71d40-9b47-476b-9d31-8b13de2c71e9 tempest-VolumesNegativeTest-990260601 None] Created volume successfully. Apr 14 03:53:30 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=217,cinder:UPDATE=245,cinder:INSERT=73,cinder:DELETE=18 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:53:30 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=201,cinder:INSERT=60,cinder:UPDATE=295,cinder:DELETE=21 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Flow 'volume_create_manager' (f0c91013-9091-4e14-ae43-add7d7878ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c8c6f6-9a68-44bd-9292-f77b1b7c0ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c8c6f6-9a68-44bd-9292-f77b1b7c0ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1483896122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25446218-cae4-45fd-adc2-6c9cb9dc580c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1610ef596ed4ffd996eeffce241e1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:34Z,use_quota=True,user_id='55fdad97dd4b4d76a2a39ae91a44a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097bbf6b-7d40-4d84-8df3-dcd9f48e5165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097bbf6b-7d40-4d84-8df3-dcd9f48e5165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e634b8-ca23-484b-bb9f-1011b9e8c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e634b8-ca23-484b-bb9f-1011b9e8c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25446218-cae4-45fd-adc2-6c9cb9dc580c', 'volume_name': 'volume-25446218-cae4-45fd-adc2-6c9cb9dc580c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40f8190-8935-45f1-acea-ab48383d5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40f8190-8935-45f1-acea-ab48383d5c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9862df1f-e10d-4431-b296-ef17c3c51460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:33 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Volume 25446218-cae4-45fd-adc2-6c9cb9dc580c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25446218-cae4-45fd-adc2-6c9cb9dc580c', 'volume_size': 1} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1483896122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25446218-cae4-45fd-adc2-6c9cb9dc580c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1610ef596ed4ffd996eeffce241e1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:34Z,use_quota=True,user_id='55fdad97dd4b4d76a2a39ae91a44a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Creating volume 25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:33 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:53:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:33 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c 1073741824 Apr 14 03:53:33 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:34 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c 1073741824" returned: 0 in 0.772s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:34 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:34 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:35 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.551s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9862df1f-e10d-4431-b296-ef17c3c51460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25446218-cae4-45fd-adc2-6c9cb9dc580c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0eab332-78d2-4212-b324-f75b369d4785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:35 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Volume volume-25446218-cae4-45fd-adc2-6c9cb9dc580c (25446218-cae4-45fd-adc2-6c9cb9dc580c): created successfully Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0eab332-78d2-4212-b324-f75b369d4785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Flow 'volume_create_manager' (f0c91013-9091-4e14-ae43-add7d7878ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6a3b382f-e8cd-4477-a69f-12d1a304aedd tempest-SnapshotDependencyTests-1166622160 None] Created volume successfully. Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Creating offline snapshot 73288426-e3ed-466b-ae3a-95a0705b8cbd of volume 25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfec38a-d3ec-4de4-860a-247289b53d0c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:36 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:36 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:36 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.510s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:36 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd 1G Apr 14 03:53:36 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:37 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd 1G" returned: 0 in 0.621s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25446218-cae4-45fd-adc2-6c9cb9dc580c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:37 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25446218-cae4-45fd-adc2-6c9cb9dc580c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:37 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:37 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25446218-cae4-45fd-adc2-6c9cb9dc580c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:37 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd is being set with open permissions: ugo+rw Apr 14 03:53:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:37 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:37 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:38 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.517s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:38 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info Apr 14 03:53:38 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:38 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info" returned: 0 in 0.433s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:38 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info is being set with open permissions: ugo+rw Apr 14 03:53:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:38 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info Apr 14 03:53:38 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:39 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.info" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d4615ee4-b89e-4679-b4dd-cb907beec358 tempest-SnapshotDependencyTests-1166622160 None] Create snapshot completed successfully Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Flow 'volume_create_manager' (231b9f36-f7da-4b0b-9980-3fb18fed9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24b5f8d-fd2d-4b35-84ff-c187a072ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24b5f8d-fd2d-4b35-84ff-c187a072ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcb1cf0-c521-4b55-bb01-7327145003da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1610ef596ed4ffd996eeffce241e1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73288426-e3ed-466b-ae3a-95a0705b8cbd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:53:41Z,use_quota=True,user_id='55fdad97dd4b4d76a2a39ae91a44a0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0c6af2-cefa-4386-8595-c926bb4496d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0c6af2-cefa-4386-8595-c926bb4496d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36acfd66-180e-4fe7-8d36-52fefff25b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36acfd66-180e-4fe7-8d36-52fefff25b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'edcb1cf0-c521-4b55-bb01-7327145003da', 'volume_name': 'volume-edcb1cf0-c521-4b55-bb01-7327145003da', 'volume_size': 1, 'snapshot_id': '73288426-e3ed-466b-ae3a-95a0705b8cbd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7b3b68-b7ea-4406-bbfe-e960529c4daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7b3b68-b7ea-4406-bbfe-e960529c4daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee12253e-b0bb-4713-9792-de5c9ecfc702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:40 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Volume edcb1cf0-c521-4b55-bb01-7327145003da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-edcb1cf0-c521-4b55-bb01-7327145003da', 'volume_size': 1, 'snapshot_id': '73288426-e3ed-466b-ae3a-95a0705b8cbd'} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd-edcb1cf0-c521-4b55-bb01-7327145003da" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd-edcb1cf0-c521-4b55-bb01-7327145003da" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Creating volume edcb1cf0-c521-4b55-bb01-7327145003da from snapshot 73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] snapshot: 73288426-e3ed-466b-ae3a-95a0705b8cbd, volume: edcb1cf0-c521-4b55-bb01-7327145003da, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f58331d-0d4c-4383-b9bf-e3759d0bc3d4]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:40 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:40 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:41 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.589s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25446218-cae4-45fd-adc2-6c9cb9dc580c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f086c3f-4d7f-43e0-aee8-6c601d350ad5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:41 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:41 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:42 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.926s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:42 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:53:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:42 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da Apr 14 03:53:42 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:45 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da" returned: 0 in 2.933s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:45 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1937a81-f418-42d8-8c86-e46b2fcfa48e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:45 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:45 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:46 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.824s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c, size 1024.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:53:46 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Converted 1024.00 MB image at 349.03 MB/s Apr 14 03:53:46 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da is being set with open permissions: ugo+rw Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:46 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da Apr 14 03:53:46 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:46 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da" returned: 0 in 0.523s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" released by "_copy_volume_from_snapshot" :: held 5.864s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd-edcb1cf0-c521-4b55-bb01-7327145003da" released by "_create_volume_from_snapshot" :: held 5.881s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.891s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee12253e-b0bb-4713-9792-de5c9ecfc702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcb1cf0-c521-4b55-bb01-7327145003da', 'volume_size': 1, 'snapshot_id': '73288426-e3ed-466b-ae3a-95a0705b8cbd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf01336d-4d04-4910-b2f3-701da08954cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:53:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Volume volume-edcb1cf0-c521-4b55-bb01-7327145003da (edcb1cf0-c521-4b55-bb01-7327145003da): created successfully Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf01336d-4d04-4910-b2f3-701da08954cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:53:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Flow 'volume_create_manager' (231b9f36-f7da-4b0b-9980-3fb18fed9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:53:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-61b785a9-eeff-41e2-a819-a351c5c53b81 tempest-SnapshotDependencyTests-1166622160 None] Created volume successfully. Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1ca28d7e-9462-42c6-8035-21c7563c7f3c tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" by "attach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1ca28d7e-9462-42c6-8035-21c7563c7f3c tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" acquired by "attach_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1ca28d7e-9462-42c6-8035-21c7563c7f3c tempest-VolumesActionsTest-338693723 None] Attaching volume 615d699a-b6dd-4298-8b5e-cf2517989f8e to instance 93066b74-305a-4565-8d1c-6a977a307af5 at mountpoint /dev/vdb on host None. Apr 14 03:53:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1ca28d7e-9462-42c6-8035-21c7563c7f3c tempest-VolumesActionsTest-338693723 None] Attach volume completed successfully. Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1ca28d7e-9462-42c6-8035-21c7563c7f3c tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e" released by "attach_volume" :: held 0.059s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-73288426-e3ed-466b-ae3a-95a0705b8cbd-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-73288426-e3ed-466b-ae3a-95a0705b8cbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Deleting offline snapshot 73288426-e3ed-466b-ae3a-95a0705b8cbd of volume 25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] snapshot_file for this snap is: volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f63a363-b592-4c31-85ce-96ccaba84ade]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:47 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:47 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f9b7daab-5b2c-49c8-aaba-9ef06a28a0df tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" by "detach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f9b7daab-5b2c-49c8-aaba-9ef06a28a0df tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f9b7daab-5b2c-49c8-aaba-9ef06a28a0df tempest-VolumesActionsTest-338693723 None] Detaching volume 615d699a-b6dd-4298-8b5e-cf2517989f8e from instance 93066b74-305a-4565-8d1c-6a977a307af5. Apr 14 03:53:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f9b7daab-5b2c-49c8-aaba-9ef06a28a0df tempest-VolumesActionsTest-338693723 None] Detach volume completed successfully. Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f9b7daab-5b2c-49c8-aaba-9ef06a28a0df tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:47 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25446218-cae4-45fd-adc2-6c9cb9dc580c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f24b42-3a75-47e8-a95c-001dd3845c0b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:48 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:48 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:48 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.538s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:48 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:48 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:48 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:48 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd Apr 14 03:53:49 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:49 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c.73288426-e3ed-466b-ae3a-95a0705b8cbd" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-73288426-e3ed-466b-ae3a-95a0705b8cbd" released by "_delete_snapshot" :: held 2.150s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" released by "delete_snapshot" :: held 2.164s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:49 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Created reservations ['21bf30bb-d796-47b2-a8ce-c63bcc45e6aa', 'f7fa90ee-a564-44d6-8cf2-f8401b6cbcdc', 'a4b56881-a039-47bb-b462-b9fb75e0fc97', '4440b3d9-363f-4154-9a25-3512c31eeac0'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Delete snapshot completed successfully. Apr 14 03:53:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-88c2b51f-46e9-4abb-8b55-a765540fb376 tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-73288426-e3ed-466b-ae3a-95a0705b8cbd-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-25446218-cae4-45fd-adc2-6c9cb9dc580c-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-25446218-cae4-45fd-adc2-6c9cb9dc580c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a392e3-e2b1-4483-8cdb-f0c3b68e9979]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:50 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:50 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:51 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.595s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:51 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c Apr 14 03:53:51 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:51 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-25446218-cae4-45fd-adc2-6c9cb9dc580c" returned: 0 in 0.494s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-25446218-cae4-45fd-adc2-6c9cb9dc580c" released by "delete_volume" :: held 1.121s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Created reservations ['4e83007a-8f5e-4ed6-b254-db5c37d8cfac', 'b83ed6f7-ae77-4a09-bdcd-75a7ba721dd4', 'de07656c-46ff-4b8b-8a65-c1c6d8e4f28e', 'd9aa9dd3-c7e8-4b8f-b8c4-0aa9ba5a3513'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:51 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:51 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:52 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Deleted volume successfully. Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ca9dbd98-7e3f-45df-9045-dd4abd5bf58b tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-25446218-cae4-45fd-adc2-6c9cb9dc580c-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-edcb1cf0-c521-4b55-bb01-7327145003da-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-edcb1cf0-c521-4b55-bb01-7327145003da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20d1ece-d830-4a59-8fda-237f1129132b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:52 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da Apr 14 03:53:52 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:53 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da" returned: 0 in 0.530s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:53 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da Apr 14 03:53:53 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:53 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-edcb1cf0-c521-4b55-bb01-7327145003da" returned: 0 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-quobyte-edcb1cf0-c521-4b55-bb01-7327145003da" released by "delete_volume" :: held 1.076s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Created reservations ['535b4259-925e-450d-91a6-4bd021dc55a3', '4a71729a-dec5-49ae-a8b6-d60fec5ccc71', '5e4ee447-7035-4768-8b42-a05018814630', 'a09ef56b-fbab-4427-8f43-f0ad833956bf'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:53 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:53 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:54 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:54 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:53:54 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Deleted volume successfully. Apr 14 03:53:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-61be26d3-de1c-4adb-94b0-0f0f678d835d tempest-SnapshotDependencyTests-1166622160 None] Lock "cinder-edcb1cf0-c521-4b55-bb01-7327145003da-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:53:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:55 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d2e6e-7ce1-4973-b1da-7871a7fc5f6c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:55 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:53:55 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:56 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.571s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b35de4-3edf-49e5-b941-06aed8ea0164]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:56 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:53:56 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:56 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.715s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.fcf16bb9-e163-4b7d-9cf4-028cbc884575ujb4wzx7.img {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:56 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.fcf16bb9-e163-4b7d-9cf4-028cbc884575ujb4wzx7.img Apr 14 03:53:56 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:53:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:58 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:53:58 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:59 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.fcf16bb9-e163-4b7d-9cf4-028cbc884575ujb4wzx7.img" returned: 0 in 2.720s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb933729-6599-403b-92b4-394674165769]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:53:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:53:59 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:53:59 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:53:59 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 14 03:53:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.992s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:53:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:00 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.725s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:00 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.fcf16bb9-e163-4b7d-9cf4-028cbc884575ujb4wzx7.img {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:54:00 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Converted 1024.00 MB image at 376.19 MB/s Apr 14 03:54:00 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] fcf16bb9-e163-4b7d-9cf4-028cbc884575 was raw, no need to convert to raw {{(pid=82370) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (92f8c752-4da3-4ffb-8d51-b1717d58971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ae1a3-2ceb-4789-84b3-e988a93360d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ae1a3-2ceb-4789-84b3-e988a93360d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562879338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a28eedd-279b-4c5e-8ceb-803b4681e171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:05Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c74d02d-c7e7-47c1-a8b8-b3d25ba56f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c74d02d-c7e7-47c1-a8b8-b3d25ba56f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24e3792-b39b-401d-86ce-dd3b415cc9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24e3792-b39b-401d-86ce-dd3b415cc9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a28eedd-279b-4c5e-8ceb-803b4681e171', 'volume_name': 'volume-8a28eedd-279b-4c5e-8ceb-803b4681e171', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7facbc70-34d0-4aa3-a594-e021a5f8b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7facbc70-34d0-4aa3-a594-e021a5f8b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc9f063-39c8-4573-827b-a673fc43a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:05 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Volume 8a28eedd-279b-4c5e-8ceb-803b4681e171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a28eedd-279b-4c5e-8ceb-803b4681e171', 'volume_size': 1} Apr 14 03:54:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Acquiring lock "cinder-a2c145b6-7b12-4330-ac78-253d7714962e-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "cinder-a2c145b6-7b12-4330-ac78-253d7714962e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Acquiring lock "cinder-quobyte-a2c145b6-7b12-4330-ac78-253d7714962e" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "cinder-quobyte-a2c145b6-7b12-4330-ac78-253d7714962e" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd940d0-66f3-498a-ab87-21d7eefc6154]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:09 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e Apr 14 03:54:09 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:09 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:09 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e Apr 14 03:54:09 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:10 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a2c145b6-7b12-4330-ac78-253d7714962e" returned: 0 in 0.424s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "cinder-quobyte-a2c145b6-7b12-4330-ac78-253d7714962e" released by "delete_volume" :: held 0.964s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Created reservations ['28df84d8-e027-4a30-a759-d507e25cba1c', 'bdc3d50f-6602-424f-bdde-a268ffaa249b', '2c6d64d3-503f-4a6e-aea6-7e4299002499', '20f1567c-02f6-4d74-90c6-6a15d797255b'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:10 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:10 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:10 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Deleted volume successfully. Apr 14 03:54:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7eaff0f0-2c92-4059-839e-4b6ccb4c049f tempest-VolumesNegativeTest-990260601 None] Lock "cinder-a2c145b6-7b12-4330-ac78-253d7714962e-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.951s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Uploaded volume to glance image-id: fcf16bb9-e163-4b7d-9cf4-028cbc884575. {{(pid=82370) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.462s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562879338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a28eedd-279b-4c5e-8ceb-803b4681e171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:05Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Creating volume 8a28eedd-279b-4c5e-8ceb-803b4681e171 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:12 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:12 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 1073741824 Apr 14 03:54:12 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-53446fb0-530e-49b2-8561-b851bbc4bf7e tempest-VolumesActionsTest-338693723 None] Copy volume to image completed successfully. Apr 14 03:54:13 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 1073741824" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:13 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 Apr 14 03:54:13 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:13 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171" returned: 0 in 0.454s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.077s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc9f063-39c8-4573-827b-a673fc43a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a28eedd-279b-4c5e-8ceb-803b4681e171', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7e4530-d62e-4b68-8aa6-f4462f984ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e1be66-3976-414f-adb8-c480bbeb2697]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:13 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Volume volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 (8a28eedd-279b-4c5e-8ceb-803b4681e171): created successfully Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7e4530-d62e-4b68-8aa6-f4462f984ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (92f8c752-4da3-4ffb-8d51-b1717d58971f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b859e228-2ddf-4ad2-9418-6d4d358ae83b tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:13 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:54:13 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:14 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49e768-b76f-4ab7-8571-a1e174310647]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:14 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:54:14 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-76f2a65b-1569-4927-b558-4e43e3289fc7 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171" by "attach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-76f2a65b-1569-4927-b558-4e43e3289fc7 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171" acquired by "attach_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:14 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:14 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img Apr 14 03:54:14 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-76f2a65b-1569-4927-b558-4e43e3289fc7 tempest-VolumesActionsTest-2122252811 None] Attaching volume 8a28eedd-279b-4c5e-8ceb-803b4681e171 to instance ac2e55e7-c8e6-4d6c-b0f0-769a83870192 at mountpoint /dev/vdb on host None. Apr 14 03:54:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-76f2a65b-1569-4927-b558-4e43e3289fc7 tempest-VolumesActionsTest-2122252811 None] Attach volume completed successfully. Apr 14 03:54:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-76f2a65b-1569-4927-b558-4e43e3289fc7 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171" released by "attach_volume" :: held 0.078s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Terminate volume connection completed successfully. Apr 14 03:54:16 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img" returned: 0 in 2.263s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" by "detach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b3be2d-7030-439a-a397-abe1dc6604d2]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Detaching volume 8a28eedd-279b-4c5e-8ceb-803b4681e171 from instance ac2e55e7-c8e6-4d6c-b0f0-769a83870192. Apr 14 03:54:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Detach volume completed successfully. Apr 14 03:54:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-dc775eda-0401-4104-8d97-5cf2e1cd3b75 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:16 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:54:16 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:17 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.595s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:54:17 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Converted 1024.00 MB image at 452.31 MB/s Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] b40c442b-92cc-4681-a0de-18e64b9202ef was raw, converting to qcow2 {{(pid=82370) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[905086e2-02a4-4e48-a281-1d0daef929dd]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-abf9ea2f-3639-451a-acf0-e1c265367e5d tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" by "detach_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-abf9ea2f-3639-451a-acf0-e1c265367e5d tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:17 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-abf9ea2f-3639-451a-acf0-e1c265367e5d tempest-VolumesActionsTest-2122252811 None] Volume detach called, but volume not attached. Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-abf9ea2f-3639-451a-acf0-e1c265367e5d tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:17 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img Apr 14 03:54:17 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:17 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:18 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img Apr 14 03:54:18 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-quobyte-8a28eedd-279b-4c5e-8ceb-803b4681e171" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-quobyte-8a28eedd-279b-4c5e-8ceb-803b4681e171" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5aa465-9466-4e09-8d2e-ba4918552baf]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:18 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 Apr 14 03:54:18 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:18 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img" returned: 1 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:18 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06 Apr 14 03:54:18 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:18 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:18 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171 Apr 14 03:54:18 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:18 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06" returned: 0 in 0.427s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Image conversion details: src /opt/stack/data/cinder/conversion/615d699a-b6dd-4298-8b5e-cf2517989f8e.temp_image.b40c442b-92cc-4681-a0de-18e64b9202ef96to1wrg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:54:18 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd90abb-3004-4d6e-9c97-f88c499d864c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:18 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06 Apr 14 03:54:18 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:19 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8a28eedd-279b-4c5e-8ceb-803b4681e171" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-quobyte-8a28eedd-279b-4c5e-8ceb-803b4681e171" released by "delete_volume" :: held 0.908s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Created reservations ['bdb938cf-8488-44c0-9a2b-6a7ad07b321e', '1c46d789-94be-4388-bb00-f36745fa0bc2', '90cd5307-97b0-4ee5-bf43-f8d56495b292', '5b66ba61-4f99-42b1-a08d-499a816aaa74'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:19 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:19 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:19 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq7dqe06" returned: 0 in 0.514s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:19 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.507s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Deleted volume successfully. Apr 14 03:54:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-09aed312-5380-48cb-8940-8c0007f77364 tempest-VolumesActionsTest-2122252811 None] Lock "cinder-8a28eedd-279b-4c5e-8ceb-803b4681e171-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.696s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Uploaded volume to glance image-id: b40c442b-92cc-4681-a0de-18e64b9202ef. {{(pid=82370) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 14 03:54:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3c5e87cf-9932-452d-a386-555758162bf1 tempest-VolumesActionsTest-338693723 None] Copy volume to image completed successfully. Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Acquiring lock "cinder-quobyte-615d699a-b6dd-4298-8b5e-cf2517989f8e" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "cinder-quobyte-615d699a-b6dd-4298-8b5e-cf2517989f8e" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548b2a8-a40e-498e-aff5-1e4f6850316c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:21 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:54:21 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:21 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:21 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e Apr 14 03:54:21 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:22 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-615d699a-b6dd-4298-8b5e-cf2517989f8e" returned: 0 in 0.479s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "cinder-quobyte-615d699a-b6dd-4298-8b5e-cf2517989f8e" released by "delete_volume" :: held 0.964s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Created reservations ['b76b413c-688c-4b84-ab7b-f40512092436', 'c2ab17e8-1d71-4ca3-8f83-0eb3fd7538df', '923d6a65-9170-4d14-a534-dd6b59cb4713', '7ccb3278-182a-4ce7-abca-fa107046c3a4'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:22 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:22 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:22 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.437s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:22 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Deleted volume successfully. Apr 14 03:54:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-79cac8f7-bc6e-4087-997c-2af0a4d76d8a tempest-VolumesActionsTest-338693723 None] Lock "cinder-615d699a-b6dd-4298-8b5e-cf2517989f8e-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (fb846066-0624-4f15-a062-dbba0a585695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157584f5-5b8f-4687-8002-c0a87dfa40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157584f5-5b8f-4687-8002-c0a87dfa40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147159607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972c4d4-1256-4ac2-ac1a-0ac8b80950b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:26Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4615a22-3777-4b32-bcdf-77452c43690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4615a22-3777-4b32-bcdf-77452c43690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a5f8d-fc9e-4df4-82df-3c89850d5971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a5f8d-fc9e-4df4-82df-3c89850d5971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b972c4d4-1256-4ac2-ac1a-0ac8b80950b3', 'volume_name': 'volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e3747-6bf0-4fcb-9ff6-b1a844c12ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e3747-6bf0-4fcb-9ff6-b1a844c12ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cdfb36-ff30-41de-9d88-aac2868d1766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Volume b972c4d4-1256-4ac2-ac1a-0ac8b80950b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3', 'volume_size': 1} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147159607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972c4d4-1256-4ac2-ac1a-0ac8b80950b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:26Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Creating volume b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:25 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 1073741824 Apr 14 03:54:25 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Flow 'volume_create_manager' (a5a6f3eb-d774-4d58-9e67-ec8b477fff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209917ca-a67c-49af-9812-24d371d8cc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209917ca-a67c-49af-9812-24d371d8cc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-637570416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b923b-e3b3-4de3-a0c5-832a3c843740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef8ef49b2ae4603b2400848bb644ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:26Z,use_quota=True,user_id='f64c4890b8a94d8096981fa90c7b8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039bf564-12d3-44d7-83da-a20ead135113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039bf564-12d3-44d7-83da-a20ead135113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789a2806-6965-46eb-9f1b-a843c592c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789a2806-6965-46eb-9f1b-a843c592c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795b923b-e3b3-4de3-a0c5-832a3c843740', 'volume_name': 'volume-795b923b-e3b3-4de3-a0c5-832a3c843740', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6961570b-5b1e-41dd-a2d7-daead9dafbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6961570b-5b1e-41dd-a2d7-daead9dafbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ba21f7-d91c-4e13-9c11-cbdc71ba20f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Volume 795b923b-e3b3-4de3-a0c5-832a3c843740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795b923b-e3b3-4de3-a0c5-832a3c843740', 'volume_size': 1} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:26 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 1073741824" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:26 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 Apr 14 03:54:26 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:26 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" returned: 0 in 0.403s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-637570416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b923b-e3b3-4de3-a0c5-832a3c843740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef8ef49b2ae4603b2400848bb644ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:26Z,use_quota=True,user_id='f64c4890b8a94d8096981fa90c7b8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Creating volume 795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:26 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cdfb36-ff30-41de-9d88-aac2868d1766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 1073741824 Apr 14 03:54:26 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b00b49e-fd1d-4e03-ae96-ee01c0746cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Volume volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 (b972c4d4-1256-4ac2-ac1a-0ac8b80950b3): created successfully Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b00b49e-fd1d-4e03-ae96-ee01c0746cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (fb846066-0624-4f15-a062-dbba0a585695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b882c56e-3dae-402c-bc9e-7b4345b4ab91 tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:27 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 1073741824" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:27 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:27 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:27 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.398s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ba21f7-d91c-4e13-9c11-cbdc71ba20f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795b923b-e3b3-4de3-a0c5-832a3c843740', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604a4521-91d6-45b8-b41a-100a83cea7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Volume volume-795b923b-e3b3-4de3-a0c5-832a3c843740 (795b923b-e3b3-4de3-a0c5-832a3c843740): created successfully Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604a4521-91d6-45b8-b41a-100a83cea7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Flow 'volume_create_manager' (a5a6f3eb-d774-4d58-9e67-ec8b477fff34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:27 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-03b4426f-cdc5-4bec-8fe8-e595fba626b1 tempest-VolumesCloneTest-103390900 None] Created volume successfully. Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-quobyte-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[59571224-30c8-4661-a1d7-95c0d45363ca]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:27 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 Apr 14 03:54:27 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Flow 'volume_create_manager' (e075f580-ae65-4a3d-9231-f0037f5b55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25530754-f5c9-48a3-b3c4-7100acfc6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25530754-f5c9-48a3-b3c4-7100acfc6579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1916982128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa8cf13-70a7-4bb4-959c-fcf50f9e9986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef8ef49b2ae4603b2400848bb644ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=795b923b-e3b3-4de3-a0c5-832a3c843740,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:28Z,use_quota=True,user_id='f64c4890b8a94d8096981fa90c7b8785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:28 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace3a245-259d-404f-bab9-b24820d9af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace3a245-259d-404f-bab9-b24820d9af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eda24f-c1e7-4bc3-86d5-97003849059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eda24f-c1e7-4bc3-86d5-97003849059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ffa8cf13-70a7-4bb4-959c-fcf50f9e9986', 'volume_name': 'volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986', 'volume_size': 2, 'source_volid': '795b923b-e3b3-4de3-a0c5-832a3c843740', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3838d2-7025-48eb-ae42-7a7f1fe3429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3838d2-7025-48eb-ae42-7a7f1fe3429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289f280f-6559-47e7-8506-29d994b3f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:28 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Volume ffa8cf13-70a7-4bb4-959c-fcf50f9e9986: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986', 'volume_size': 2, 'source_volid': '795b923b-e3b3-4de3-a0c5-832a3c843740', 'source_volstatus': 'available'} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" returned: 0 in 0.514s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:28 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Cloning volume 795b923b-e3b3-4de3-a0c5-832a3c843740 to volume ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 Apr 14 03:54:28 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3 Apr 14 03:54:28 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Creating offline snapshot 1b22ec4a-b116-4dc4-a886-210175786766 of volume 795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7819148-f3e7-4d2f-8bc7-a722d87b32c8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:28 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:28 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:28 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" returned: 0 in 0.407s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3" released by "delete_volume" :: held 0.949s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Created reservations ['7f41c242-a4ac-48e1-9dae-7df1a841fdb4', 'bde15e7f-0f60-438a-b593-566fa4d8793a', 'a275fc8b-8cac-4394-b4ee-9c7a096cb40e', '1ab05b46-f88d-4bb8-b384-679c99c45c74'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:28 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:28 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:28 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.481s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:28 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 1G Apr 14 03:54:28 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (218100ab-292d-4639-85ac-361baf4dbf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e750bb95-ade5-4a05-8850-772e121557bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e750bb95-ade5-4a05-8850-772e121557bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558350673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa52a31c-0dc6-41ef-89a9-40b9502b56bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:29Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141f8687-315d-460b-bd20-5a47e4ea07cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141f8687-315d-460b-bd20-5a47e4ea07cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f13987d-5d45-4a51-b73a-003c5f876295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f13987d-5d45-4a51-b73a-003c5f876295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa52a31c-0dc6-41ef-89a9-40b9502b56bf', 'volume_name': 'volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26643baa-c4b4-46ed-836a-e0b18682cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26643baa-c4b4-46ed-836a-e0b18682cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b7bbb-df5d-4994-94b3-e682184c633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:29 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Volume fa52a31c-0dc6-41ef-89a9-40b9502b56bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf', 'volume_size': 1} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:29 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Deleted volume successfully. Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81e22032-11b7-4967-9299-9d99b32fe3b8 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-b972c4d4-1256-4ac2-ac1a-0ac8b80950b3-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:29 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 1G" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795b923b-e3b3-4de3-a0c5-832a3c843740 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:29 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795b923b-e3b3-4de3-a0c5-832a3c843740 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:29 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:29 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795b923b-e3b3-4de3-a0c5-832a3c843740 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.421s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:29 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 is being set with open permissions: ugo+rw Apr 14 03:54:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:29 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:29 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:30 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:30 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info Apr 14 03:54:30 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:30 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:30 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info is being set with open permissions: ugo+rw Apr 14 03:54:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:30 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info Apr 14 03:54:30 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:31 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.info" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] snapshot: 1b22ec4a-b116-4dc4-a886-210175786766, volume: ffa8cf13-70a7-4bb4-959c-fcf50f9e9986, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c3a4a5-7bca-47f9-8730-bb32648f38a0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:31 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:31 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:31 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-795b923b-e3b3-4de3-a0c5-832a3c843740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf78f2-0457-4561-af75-cf29d2809512]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:31 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:31 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:32 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.456s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:32 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:54:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:32 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 Apr 14 03:54:32 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:34 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" returned: 0 in 1.916s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c524d25-9602-4845-a485-369d7e16d304]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:34 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:34 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:34 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:54:34 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Converted 1024.00 MB image at 533.87 MB/s Apr 14 03:54:34 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 is being set with open permissions: ugo+rw Apr 14 03:54:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:34 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 Apr 14 03:54:34 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:35 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" returned: 0 in 0.404s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" released by "_copy_volume_from_snapshot" :: held 3.905s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=71,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-quobyte-1b22ec4a-b116-4dc4-a886-210175786766" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-1b22ec4a-b116-4dc4-a886-210175786766" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Deleting offline snapshot 1b22ec4a-b116-4dc4-a886-210175786766 of volume 795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] snapshot_file for this snap is: volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971b9bc-da31-4e89-b21e-ac7141dccaf9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:35 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:35 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:35 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-795b923b-e3b3-4de3-a0c5-832a3c843740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d25837-5470-475a-802c-40186c64d1f1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:35 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:35 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:36 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:36 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:36 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:36 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:36 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766 Apr 14 03:54:36 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:36 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740.1b22ec4a-b116-4dc4-a886-210175786766" returned: 0 in 0.416s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-1b22ec4a-b116-4dc4-a886-210175786766" released by "_delete_snapshot" :: held 1.835s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=78,cinder:SELECT=75,cinder:INSERT=18,cinder:DELETE=4 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.495s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.656s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558350673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa52a31c-0dc6-41ef-89a9-40b9502b56bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:29Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Creating volume fa52a31c-0dc6-41ef-89a9-40b9502b56bf {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:36 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289f280f-6559-47e7-8506-29d994b3f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986', 'volume_size': 2, 'source_volid': '795b923b-e3b3-4de3-a0c5-832a3c843740', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcb851-1a3a-4ddd-9496-c7bc6248b8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:36 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf 1073741824 Apr 14 03:54:36 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:36 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Volume volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 (ffa8cf13-70a7-4bb4-959c-fcf50f9e9986): created successfully Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcb851-1a3a-4ddd-9496-c7bc6248b8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Flow 'volume_create_manager' (e075f580-ae65-4a3d-9231-f0037f5b55e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5a729f2f-7185-4ef7-9ee1-aa2d146ecd39 tempest-VolumesCloneTest-103390900 None] Created volume successfully. Apr 14 03:54:37 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf 1073741824" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:37 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf Apr 14 03:54:37 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:37 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14b7bbb-df5d-4994-94b3-e682184c633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013ef477-545a-4af9-b16a-fba2676e414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:37 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Volume volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf (fa52a31c-0dc6-41ef-89a9-40b9502b56bf): created successfully Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013ef477-545a-4af9-b16a-fba2676e414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (218100ab-292d-4639-85ac-361baf4dbf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7f22c62d-b4fd-4b65-9bb0-6c8833dd3c19 tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "cinder-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fa8033-56af-4ce0-9dbd-e232d25cf493]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:38 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 Apr 14 03:54:38 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:38 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:38 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986 Apr 14 03:54:38 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-fa52a31c-0dc6-41ef-89a9-40b9502b56bf-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "cinder-fa52a31c-0dc6-41ef-89a9-40b9502b56bf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-quobyte-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:38 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986" released by "delete_volume" :: held 0.942s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964ed80-2360-430e-b6ed-436033c752bb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Created reservations ['dcf49e04-7d30-484c-b231-1894495061f2', 'd1801267-f7b2-4b9c-8728-23a5f4a49c8f', '6928ffb7-c3a7-4f50-9f2c-74b7885fb8d3', '21d414bc-1699-4ab7-b4db-bb0181d8203d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:38 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf Apr 14 03:54:38 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:39 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:39 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-795b923b-e3b3-4de3-a0c5-832a3c843740-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "cinder-795b923b-e3b3-4de3-a0c5-832a3c843740-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Acquiring lock "cinder-quobyte-795b923b-e3b3-4de3-a0c5-832a3c843740" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-795b923b-e3b3-4de3-a0c5-832a3c843740" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a497f5-37ce-42f9-8362-0a1448615972]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:39 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:39 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:39 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:39 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Deleted volume successfully. Apr 14 03:54:39 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf Apr 14 03:54:39 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4aadf85f-c2b2-4837-b633-6a7770ee96db tempest-VolumesCloneTest-103390900 None] Lock "cinder-ffa8cf13-70a7-4bb4-959c-fcf50f9e9986-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:39 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:39 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740 Apr 14 03:54:39 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:39 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-fa52a31c-0dc6-41ef-89a9-40b9502b56bf" released by "delete_volume" :: held 0.943s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Created reservations ['167797c7-2df4-4483-b186-420f7f92830a', '98496f5d-ba2e-42fe-be17-7977f6faf0d0', '3760c328-0a2b-43b5-b5c0-99599be91b78', 'ea9b0514-6447-455a-a15d-36dbe68f5977'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:39 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:39 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:40 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-795b923b-e3b3-4de3-a0c5-832a3c843740" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "cinder-quobyte-795b923b-e3b3-4de3-a0c5-832a3c843740" released by "delete_volume" :: held 0.950s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Created reservations ['0d053526-7673-4d88-a62f-a0a210b0ae78', '3c1ee108-d31d-4a43-881a-dbe055c2f11d', '2cc8602a-966e-40b2-97d7-01e7bfc78d6f', '4877723b-bac6-4b30-95c7-125c811e4161'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:40 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:40 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (2cc346f2-585e-4b87-b5bf-cc22cba3a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492274a-21dd-4f8c-aa3c-1322f90dd061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492274a-21dd-4f8c-aa3c-1322f90dd061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414203315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f8f874-4cb5-414d-a2ac-df753fcd0489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:40Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6112170-49c0-48a9-8058-f828cce2a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6112170-49c0-48a9-8058-f828cce2a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaea2ee-cdb2-4f94-b6ac-4e3622bb0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaea2ee-cdb2-4f94-b6ac-4e3622bb0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f8f874-4cb5-414d-a2ac-df753fcd0489', 'volume_name': 'volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ff703b-7456-45ba-be0c-c90654c02c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ff703b-7456-45ba-be0c-c90654c02c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5affeca-9486-4447-8927-56a72384dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:40 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Volume a0f8f874-4cb5-414d-a2ac-df753fcd0489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489', 'volume_size': 1} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414203315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f8f874-4cb5-414d-a2ac-df753fcd0489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:40Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Creating volume a0f8f874-4cb5-414d-a2ac-df753fcd0489 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:40 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:40 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 1073741824 Apr 14 03:54:40 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:40 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Deleted volume successfully. Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-db9ecded-9610-43fb-acbc-04c6b56b400d tempest-VolumesActionsTest-1280151861 None] Lock "cinder-fa52a31c-0dc6-41ef-89a9-40b9502b56bf-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:40 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Deleted volume successfully. Apr 14 03:54:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ea4fc10-dc80-4808-a056-11848b3c0eab tempest-VolumesCloneTest-103390900 None] Lock "cinder-795b923b-e3b3-4de3-a0c5-832a3c843740-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:41 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 1073741824" returned: 0 in 0.655s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:41 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 Apr 14 03:54:41 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:41 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489" returned: 0 in 0.454s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5affeca-9486-4447-8927-56a72384dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ff9e12-41c6-4788-ae62-b429ec6b486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Volume volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 (a0f8f874-4cb5-414d-a2ac-df753fcd0489): created successfully Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ff9e12-41c6-4788-ae62-b429ec6b486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (2cc346f2-585e-4b87-b5bf-cc22cba3a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:41 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bd966fa8-42e4-465c-8741-da8c1f67d9df tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (2bf25255-e6dc-4162-a162-38b475ce3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87cf30-4212-4c8e-be0b-f6414eb8ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87cf30-4212-4c8e-be0b-f6414eb8ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60170323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9371c9-f623-41cc-8f6d-610955e463b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:42Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaacaef3-89c9-479f-9898-f7427471358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaacaef3-89c9-479f-9898-f7427471358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1343824-c914-4e83-9bf3-0431fe2ebfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1343824-c914-4e83-9bf3-0431fe2ebfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9371c9-f623-41cc-8f6d-610955e463b3', 'volume_name': 'volume-9e9371c9-f623-41cc-8f6d-610955e463b3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa25c2af-f3db-4d62-a2f7-fa153873af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa25c2af-f3db-4d62-a2f7-fa153873af94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4615c83-5464-4eff-9ecc-115428731aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:41 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Volume 9e9371c9-f623-41cc-8f6d-610955e463b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9371c9-f623-41cc-8f6d-610955e463b3', 'volume_size': 1} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60170323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9371c9-f623-41cc-8f6d-610955e463b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:42Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Creating volume 9e9371c9-f623-41cc-8f6d-610955e463b3 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:41 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:41 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 1073741824 Apr 14 03:54:41 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:42 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 1073741824" returned: 0 in 0.499s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:42 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 Apr 14 03:54:42 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-a0f8f874-4cb5-414d-a2ac-df753fcd0489-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "cinder-a0f8f874-4cb5-414d-a2ac-df753fcd0489-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-quobyte-a0f8f874-4cb5-414d-a2ac-df753fcd0489" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-a0f8f874-4cb5-414d-a2ac-df753fcd0489" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f10348-538e-4845-94ed-5d9fdf2ea7c9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:42 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 Apr 14 03:54:42 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:42 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4615c83-5464-4eff-9ecc-115428731aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9371c9-f623-41cc-8f6d-610955e463b3', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d5cd44-c652-4ba7-b40a-e071f9d512a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:42 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Volume volume-9e9371c9-f623-41cc-8f6d-610955e463b3 (9e9371c9-f623-41cc-8f6d-610955e463b3): created successfully Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d5cd44-c652-4ba7-b40a-e071f9d512a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:42 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (2bf25255-e6dc-4162-a162-38b475ce3cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:42 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-36c2d92b-d97e-47c0-aa25-7b0d75d5fb2b tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:54:43 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489" returned: 0 in 0.479s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:43 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489 Apr 14 03:54:43 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:43 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a0f8f874-4cb5-414d-a2ac-df753fcd0489" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-a0f8f874-4cb5-414d-a2ac-df753fcd0489" released by "delete_volume" :: held 0.910s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Created reservations ['2e4a9397-595e-462f-a478-5817f4fdb99e', 'c6bb85c1-a1cf-4b19-b6d7-c6b8d9274a2a', '9aa3cfee-8d2b-4574-96bb-292818a2f6cd', 'f27759cc-ad28-42de-a98c-465c20d40cc2'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:43 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:43 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (ea066364-b25d-451a-8846-f07838cf61e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff31ad55-27eb-4979-bf80-8f3ba54fa105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff31ad55-27eb-4979-bf80-8f3ba54fa105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-693442978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41deba18-8a09-4eb0-a0a8-a6d877fe22b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:44Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3355191-7a26-4306-b539-024f39c7169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3355191-7a26-4306-b539-024f39c7169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5592cd17-cf2f-4fae-bdfe-9ab289b97310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5592cd17-cf2f-4fae-bdfe-9ab289b97310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41deba18-8a09-4eb0-a0a8-a6d877fe22b2', 'volume_name': 'volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f0e05-6c99-4d9e-9af6-9c8ceaaf44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f0e05-6c99-4d9e-9af6-9c8ceaaf44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04e6d12-236b-46c3-a217-6eaee30f0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:43 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Volume 41deba18-8a09-4eb0-a0a8-a6d877fe22b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2', 'volume_size': 1} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-693442978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41deba18-8a09-4eb0-a0a8-a6d877fe22b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:44Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Creating volume 41deba18-8a09-4eb0-a0a8-a6d877fe22b2 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:43 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:43 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 1073741824 Apr 14 03:54:43 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:43 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:43 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Deleted volume successfully. Apr 14 03:54:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2f8f3715-d6a8-4eaa-b68e-e58b521c116f tempest-VolumesActionsTest-1280151861 None] Lock "cinder-a0f8f874-4cb5-414d-a2ac-df753fcd0489-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (957c9dd9-24f4-4940-836f-6bdf86ad1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edc8052-e614-428a-a08c-5cc27c660314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edc8052-e614-428a-a08c-5cc27c660314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-393569152',display_name='tempest-VolumesGetTest-Volume-1156205500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f5983f-07da-4edb-a9b0-ff18cfa27b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:44Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde8f5d-b5d4-4cfa-9931-eaff0a542ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde8f5d-b5d4-4cfa-9931-eaff0a542ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdba7f7-3aa6-48d1-b3ed-a03f8e198abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdba7f7-3aa6-48d1-b3ed-a03f8e198abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f5983f-07da-4edb-a9b0-ff18cfa27b3a', 'volume_name': 'volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f423205-6f58-4c1b-bf5e-53d63367b22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f423205-6f58-4c1b-bf5e-53d63367b22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e7111-7d81-430d-90c6-c335f89108d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Volume c8f5983f-07da-4edb-a9b0-ff18cfa27b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a', 'volume_size': 1} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:44 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 1073741824" returned: 0 in 0.546s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:44 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 Apr 14 03:54:44 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:44 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-393569152',display_name='tempest-VolumesGetTest-Volume-1156205500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f5983f-07da-4edb-a9b0-ff18cfa27b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:44Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Creating volume c8f5983f-07da-4edb-a9b0-ff18cfa27b3a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:44 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04e6d12-236b-46c3-a217-6eaee30f0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a 1073741824 Apr 14 03:54:44 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09097a3-b46e-4334-a488-5aafaad123ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Volume volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 (41deba18-8a09-4eb0-a0a8-a6d877fe22b2): created successfully Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09097a3-b46e-4334-a488-5aafaad123ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (ea066364-b25d-451a-8846-f07838cf61e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1fd80a8f-da8f-465d-a7fd-2f3200ff43de tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:45 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a 1073741824" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:45 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a Apr 14 03:54:45 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:45 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e7111-7d81-430d-90c6-c335f89108d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b5685-a83e-42b1-84f4-e507fd1bf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Volume volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a (c8f5983f-07da-4edb-a9b0-ff18cfa27b3a): created successfully Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b5685-a83e-42b1-84f4-e507fd1bf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (957c9dd9-24f4-4940-836f-6bdf86ad1178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:45 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1550a3af-1c65-4d70-aea4-73c1998d69aa tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-41deba18-8a09-4eb0-a0a8-a6d877fe22b2-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-41deba18-8a09-4eb0-a0a8-a6d877fe22b2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "cinder-quobyte-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[17511f32-b694-4f5b-8c38-dc9ea3f1f449]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:46 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 Apr 14 03:54:46 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:46 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" returned: 0 in 0.494s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "cinder-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:46 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2 Apr 14 03:54:46 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd60da-0118-4509-94b1-79d4ee094005]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:46 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a Apr 14 03:54:46 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:46 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" returned: 0 in 0.415s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-quobyte-41deba18-8a09-4eb0-a0a8-a6d877fe22b2" released by "delete_volume" :: held 0.930s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Created reservations ['c2f7a46d-06d6-4552-ba03-35fa4df8e436', 'f32ea876-5f21-4128-a386-112d192a8c78', '93ae6fda-66b6-4aef-aaa0-9d83a661de75', '137defa5-f024-40b9-9c96-0fcee0a5d29e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:47 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:47 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a Apr 14 03:54:47 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (ba8428d7-c77d-48c3-83fa-a8f4be52e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2500ed51-6ab9-41c9-bbab-9c43e58952d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2500ed51-6ab9-41c9-bbab-9c43e58952d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973831094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e394536d-b51b-410e-b065-e59891d711eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:47Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8cf75f-b966-4e1c-8235-3839813b5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8cf75f-b966-4e1c-8235-3839813b5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc1a45-6ee1-46aa-95fd-cd674fc5145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc1a45-6ee1-46aa-95fd-cd674fc5145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e394536d-b51b-410e-b065-e59891d711eb', 'volume_name': 'volume-e394536d-b51b-410e-b065-e59891d711eb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4d6cf9-beda-465d-8e76-12846b1d182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4d6cf9-beda-465d-8e76-12846b1d182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a5a4da-31db-4adb-ab9a-46afd472c564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:47 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Volume e394536d-b51b-410e-b065-e59891d711eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e394536d-b51b-410e-b065-e59891d711eb', 'volume_size': 1} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973831094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e394536d-b51b-410e-b065-e59891d711eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f255493475497bbc0b624c435c6a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:47Z,use_quota=True,user_id='aae6ac1301f9403c9dc265d81bb75b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Creating volume e394536d-b51b-410e-b065-e59891d711eb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:47 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb 1073741824 Apr 14 03:54:47 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:47 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.432s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Deleted volume successfully. Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e5a8ecf9-0388-43f3-87a6-b72778a92b72 tempest-VolumesActionsTest-1280151861 None] Lock "cinder-41deba18-8a09-4eb0-a0a8-a6d877fe22b2-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:47 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" returned: 0 in 0.446s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a" released by "delete_volume" :: held 0.951s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Created reservations ['f00ec3e5-6a3a-492c-a4d7-1300e2099656', '8381724a-f126-4d8f-9c54-a0173325dd4d', '37a5e087-e9fc-48b0-be05-11e5eb26730b', 'deaaebd3-2dd0-455a-a750-aa5bb506a379'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:47 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-9e9371c9-f623-41cc-8f6d-610955e463b3-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "cinder-9e9371c9-f623-41cc-8f6d-610955e463b3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-9e9371c9-f623-41cc-8f6d-610955e463b3" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-9e9371c9-f623-41cc-8f6d-610955e463b3" acquired by "delete_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[457de2b6-8c26-45dd-93bb-857c08f1e88a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 Apr 14 03:54:47 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:47 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb 1073741824" returned: 0 in 0.506s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:47 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb Apr 14 03:54:47 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:48 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.452s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f30205ff-f261-40ef-851b-49ce37a0f559 tempest-VolumesGetTest-1297157311 None] Lock "cinder-c8f5983f-07da-4edb-a9b0-ff18cfa27b3a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:48 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3" returned: 0 in 0.504s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:48 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3 Apr 14 03:54:48 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:48 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb" returned: 0 in 0.424s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a5a4da-31db-4adb-ab9a-46afd472c564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e394536d-b51b-410e-b065-e59891d711eb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65f85b-e977-4476-a22b-26eeb98e9306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:48 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Volume volume-e394536d-b51b-410e-b065-e59891d711eb (e394536d-b51b-410e-b065-e59891d711eb): created successfully Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65f85b-e977-4476-a22b-26eeb98e9306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Flow 'volume_create_manager' (ba8428d7-c77d-48c3-83fa-a8f4be52e3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-350eb7b2-fe94-4af4-8569-bfa698298a8b tempest-VolumesActionsTest-2122252811 None] Created volume successfully. Apr 14 03:54:48 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-9e9371c9-f623-41cc-8f6d-610955e463b3" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-9e9371c9-f623-41cc-8f6d-610955e463b3" released by "delete_volume" :: held 0.940s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Created reservations ['92129c7c-653e-4a05-8d1e-ecebe73e072f', '5c450613-3568-4ab2-96e3-5fd1aa68899c', 'a2ba15e4-767a-43e1-b982-70844d6c8228', '9fe62491-55e4-4a69-8e2b-9fe2d3351454'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:48 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:48 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (6d0f5a85-05c5-461c-996f-48a7e8b05440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21f3aa-566c-4375-8e35-7c988eb700aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21f3aa-566c-4375-8e35-7c988eb700aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308273231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d366aa0-eb0c-4115-a350-edc3870805d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:49Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cf210-6d4b-427f-aadb-ac93287de2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cf210-6d4b-427f-aadb-ac93287de2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427ecf5-79b9-443a-b2c4-0be634d13707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7427ecf5-79b9-443a-b2c4-0be634d13707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d366aa0-eb0c-4115-a350-edc3870805d6', 'volume_name': 'volume-7d366aa0-eb0c-4115-a350-edc3870805d6', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7258b17d-7862-46d9-97ac-2a1f34331bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7258b17d-7862-46d9-97ac-2a1f34331bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1add611c-d177-43cb-b11b-93346cf4c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:49 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Volume 7d366aa0-eb0c-4115-a350-edc3870805d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d366aa0-eb0c-4115-a350-edc3870805d6', 'volume_size': 1} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308273231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d366aa0-eb0c-4115-a350-edc3870805d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:49Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Creating volume 7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:54:49 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:49 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 1073741824 Apr 14 03:54:49 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:49 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a0a94f0e-c980-44af-8a4c-f7228f056e9a tempest-VolumesGetTest-1297157311 None] Lock "cinder-9e9371c9-f623-41cc-8f6d-610955e463b3-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:49 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 1073741824" returned: 0 in 0.519s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:49 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:54:49 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-e394536d-b51b-410e-b065-e59891d711eb-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "cinder-e394536d-b51b-410e-b065-e59891d711eb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Acquiring lock "cinder-quobyte-e394536d-b51b-410e-b065-e59891d711eb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "cinder-quobyte-e394536d-b51b-410e-b065-e59891d711eb" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25279e-a3a6-4680-bc11-be7f67e15bd8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:50 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb Apr 14 03:54:50 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:50 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.457s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1add611c-d177-43cb-b11b-93346cf4c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d366aa0-eb0c-4115-a350-edc3870805d6', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d7b53d-6a49-4fc4-98cb-2b5f1ed7c142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Volume volume-7d366aa0-eb0c-4115-a350-edc3870805d6 (7d366aa0-eb0c-4115-a350-edc3870805d6): created successfully Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d7b53d-6a49-4fc4-98cb-2b5f1ed7c142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (6d0f5a85-05c5-461c-996f-48a7e8b05440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e8fb4864-8f95-4508-825c-ac1bcc6fee36 tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:54:50 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:50 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb Apr 14 03:54:50 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:50 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e394536d-b51b-410e-b065-e59891d711eb" returned: 0 in 0.402s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "cinder-quobyte-e394536d-b51b-410e-b065-e59891d711eb" released by "delete_volume" :: held 0.899s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Created reservations ['2dafcb07-b891-45af-a2bd-b7689fa6b4cd', 'ce185e41-bed5-4538-90a1-4a04ff0608ab', 'b6f46926-5906-4e5b-a69d-bb34ca248caf', '169f5183-413c-48ec-993c-b97e189a4cbc'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:50 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:50 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:51 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:51 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Deleted volume successfully. Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-240da767-5834-4084-b082-538000d9e44c tempest-VolumesActionsTest-2122252811 None] Lock "cinder-e394536d-b51b-410e-b065-e59891d711eb-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (c66a7755-1fa8-45de-b963-c31d78aacab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376ad949-b9ae-4748-b96e-22fdbc49472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376ad949-b9ae-4748-b96e-22fdbc49472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2007350217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183fb977-3d96-47ed-a860-6a9dd67e2857,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7d366aa0-eb0c-4115-a350-edc3870805d6,status='creating',terminated_at=None,updated_at=2026-04-14T01:54:51Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bcc820-81f0-49c0-9d46-7a12f8d4a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bcc820-81f0-49c0-9d46-7a12f8d4a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece7f1c-3a53-45bb-9293-c79cb6e8e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece7f1c-3a53-45bb-9293-c79cb6e8e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '183fb977-3d96-47ed-a860-6a9dd67e2857', 'volume_name': 'volume-183fb977-3d96-47ed-a860-6a9dd67e2857', 'volume_size': 1, 'source_volid': '7d366aa0-eb0c-4115-a350-edc3870805d6', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7bff6b-cdbb-44ca-910b-443ed3ddf184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7bff6b-cdbb-44ca-910b-443ed3ddf184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52caa4fe-0330-47b2-860a-9e323a7467a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:54:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Volume 183fb977-3d96-47ed-a860-6a9dd67e2857: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-183fb977-3d96-47ed-a860-6a9dd67e2857', 'volume_size': 1, 'source_volid': '7d366aa0-eb0c-4115-a350-edc3870805d6', 'source_volstatus': 'available'} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:51 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Cloning volume 7d366aa0-eb0c-4115-a350-edc3870805d6 to volume 183fb977-3d96-47ed-a860-6a9dd67e2857 Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Creating offline snapshot 4f9bd7a5-1650-4136-8f03-55dbce4438c4 of volume 7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a40406e-8519-4893-9670-4eb92dc81c06]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:51 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:54:51 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:52 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:52 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 1G Apr 14 03:54:52 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:52 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 1G" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d366aa0-eb0c-4115-a350-edc3870805d6 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:52 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d366aa0-eb0c-4115-a350-edc3870805d6 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:54:52 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:53 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d366aa0-eb0c-4115-a350-edc3870805d6 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.451s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:53 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 is being set with open permissions: ugo+rw Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:53 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:54:53 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:53 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:53 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info Apr 14 03:54:53 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:53 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info" returned: 0 in 0.440s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:53 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info is being set with open permissions: ugo+rw Apr 14 03:54:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:54 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info Apr 14 03:54:54 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:54 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.info" returned: 0 in 0.411s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] snapshot: 4f9bd7a5-1650-4136-8f03-55dbce4438c4, volume: 183fb977-3d96-47ed-a860-6a9dd67e2857, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b8e0c-9f2f-44ee-87e2-f708a9b9502a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:54 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:54:54 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:54 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.515s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d366aa0-eb0c-4115-a350-edc3870805d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39dffd-ab3e-4fd2-b529-fb01d717f6a0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:55 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:54:55 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:55 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:55 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:54:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:55 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 Apr 14 03:54:55 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:57 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857" returned: 0 in 2.024s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:57 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c20557f-b476-432b-a233-cdf5bb95b4ab]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:57 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:54:57 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:58 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.704s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:54:58 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Converted 1024.00 MB image at 505.56 MB/s Apr 14 03:54:58 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 is being set with open permissions: ugo+rw Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:58 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 Apr 14 03:54:58 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:58 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857" returned: 0 in 0.452s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" released by "_copy_volume_from_snapshot" :: held 4.236s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-4f9bd7a5-1650-4136-8f03-55dbce4438c4" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-4f9bd7a5-1650-4136-8f03-55dbce4438c4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Deleting offline snapshot 4f9bd7a5-1650-4136-8f03-55dbce4438c4 of volume 7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] snapshot_file for this snap is: volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cba0717-4f5f-413d-8e4b-4871da90c6a3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:58 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:54:58 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:54:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:58 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:54:58 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:59 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.540s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d366aa0-eb0c-4115-a350-edc3870805d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[80687ebc-a843-436d-a528-5ebcbeb8c63c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:59 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:54:59 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:54:59 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.463s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:54:59 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.532s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:54:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:54:59 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:54:59 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:00 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.538s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:00 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4 Apr 14 03:55:00 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:00 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6.4f9bd7a5-1650-4136-8f03-55dbce4438c4" returned: 0 in 0.437s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-4f9bd7a5-1650-4136-8f03-55dbce4438c4" released by "_delete_snapshot" :: held 2.093s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.188s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52caa4fe-0330-47b2-860a-9e323a7467a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183fb977-3d96-47ed-a860-6a9dd67e2857', 'volume_size': 1, 'source_volid': '7d366aa0-eb0c-4115-a350-edc3870805d6', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6152c8b-a432-4352-93c4-3628c83b036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Volume volume-183fb977-3d96-47ed-a860-6a9dd67e2857 (183fb977-3d96-47ed-a860-6a9dd67e2857): created successfully Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6152c8b-a432-4352-93c4-3628c83b036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (c66a7755-1fa8-45de-b963-c31d78aacab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-952b8be4-63e8-48dc-8390-e48e171212ef tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (9f5e577d-4798-4e9c-afce-14daa29b5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6120035-4cfe-40cf-9583-470eae64e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6120035-4cfe-40cf-9583-470eae64e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674390124',display_name='tempest-VolumesGetTest-Volume-1669857867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9f6164-46e7-4eb3-b589-31d1b56092f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:01Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1955d87b-2b77-4d94-bd0c-7041aea026fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1955d87b-2b77-4d94-bd0c-7041aea026fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7798fbab-d315-44c1-8223-5f01bbcd0e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7798fbab-d315-44c1-8223-5f01bbcd0e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9f6164-46e7-4eb3-b589-31d1b56092f8', 'volume_name': 'volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d499214a-701c-4646-a869-401edb8fa77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d499214a-701c-4646-a869-401edb8fa77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ad4100-d810-432d-b902-678cc5554bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Volume 1f9f6164-46e7-4eb3-b589-31d1b56092f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8', 'volume_size': 1} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674390124',display_name='tempest-VolumesGetTest-Volume-1669857867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9f6164-46e7-4eb3-b589-31d1b56092f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:01Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Creating volume 1f9f6164-46e7-4eb3-b589-31d1b56092f8 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:01 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:01 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 1073741824 Apr 14 03:55:01 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:01 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 1073741824" returned: 0 in 0.536s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:02 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 Apr 14 03:55:02 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:02 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8" returned: 0 in 0.453s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ad4100-d810-432d-b902-678cc5554bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d16660-8dfd-4034-bf85-e077adde6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Volume volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 (1f9f6164-46e7-4eb3-b589-31d1b56092f8): created successfully Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d16660-8dfd-4034-bf85-e077adde6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (9f5e577d-4798-4e9c-afce-14daa29b5549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7c34fd06-9e3d-422c-8d64-0ed3d801d9fc tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Flow 'volume_create_manager' (eef3632b-e3ef-4529-a92e-b60ea21478d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9911af-d20b-4e5e-8f22-42fd6a623a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9911af-d20b-4e5e-8f22-42fd6a623a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2063602346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee48399-2cc9-4e6b-9835-3dbb338eb8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f421b505cc641b28fa974355ba155a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:03Z,use_quota=True,user_id='abd0fffa10f0446dbf86509087fd9586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6259f56-c6ea-4b99-a760-be1840df97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6259f56-c6ea-4b99-a760-be1840df97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183381b0-bd6c-4d6d-ae40-58f85a01fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183381b0-bd6c-4d6d-ae40-58f85a01fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee48399-2cc9-4e6b-9835-3dbb338eb8bb', 'volume_name': 'volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a8b33e-f421-4975-849c-454af49470fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a8b33e-f421-4975-849c-454af49470fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d655087-e01c-4db4-a95d-059ce8c0caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:02 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Volume 6ee48399-2cc9-4e6b-9835-3dbb338eb8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb', 'volume_size': 1} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2063602346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee48399-2cc9-4e6b-9835-3dbb338eb8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f421b505cc641b28fa974355ba155a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:03Z,use_quota=True,user_id='abd0fffa10f0446dbf86509087fd9586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Creating volume 6ee48399-2cc9-4e6b-9835-3dbb338eb8bb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:02 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:02 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb 1073741824 Apr 14 03:55:02 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:03 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb 1073741824" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:03 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb Apr 14 03:55:03 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-1f9f6164-46e7-4eb3-b589-31d1b56092f8-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "cinder-1f9f6164-46e7-4eb3-b589-31d1b56092f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-1f9f6164-46e7-4eb3-b589-31d1b56092f8" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-1f9f6164-46e7-4eb3-b589-31d1b56092f8" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a767435-2037-4966-9f45-3880017c7336]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:03 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 Apr 14 03:55:03 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:03 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d655087-e01c-4db4-a95d-059ce8c0caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14c4d42-dce2-4185-aba1-95839b20d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:03 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Volume volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb (6ee48399-2cc9-4e6b-9835-3dbb338eb8bb): created successfully Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14c4d42-dce2-4185-aba1-95839b20d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:03 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Flow 'volume_create_manager' (eef3632b-e3ef-4529-a92e-b60ea21478d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-614ea85a-6b31-429c-bc80-26140ba76de4 tempest-AbsoluteLimitsTests-1199784290 None] Created volume successfully. Apr 14 03:55:04 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:04 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8 Apr 14 03:55:04 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:04 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1f9f6164-46e7-4eb3-b589-31d1b56092f8" returned: 0 in 0.407s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-1f9f6164-46e7-4eb3-b589-31d1b56092f8" released by "delete_volume" :: held 0.900s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Created reservations ['f224712d-ab1d-4220-81db-5ae7d2b6bd1c', '0d59f67d-ca6b-4ac6-bc66-bfc60192c29e', '91b6ff2a-0a86-4391-a225-b209963ab12a', '2f9bc593-fbf1-4a00-a92d-1059d9b4a468'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:04 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:04 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-183fb977-3d96-47ed-a860-6a9dd67e2857-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "cinder-183fb977-3d96-47ed-a860-6a9dd67e2857-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be95377-080a-4b04-9848-8444bc586b7c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:04 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 Apr 14 03:55:04 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Acquiring lock "cinder-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "cinder-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Acquiring lock "cinder-quobyte-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "cinder-quobyte-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bff5c26-fe15-4f59-9db4-24adde0980e5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:05 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2c98e007-cdef-45a8-a736-fe30ab94442f tempest-VolumesGetTest-1297157311 None] Lock "cinder-1f9f6164-46e7-4eb3-b589-31d1b56092f8-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:05 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb Apr 14 03:55:05 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:05 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857" returned: 0 in 0.515s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:05 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857 Apr 14 03:55:05 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:05 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" returned: 0 in 0.485s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:05 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb Apr 14 03:55:05 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:05 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-183fb977-3d96-47ed-a860-6a9dd67e2857" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-183fb977-3d96-47ed-a860-6a9dd67e2857" released by "delete_volume" :: held 0.953s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Created reservations ['374c7b6c-12e2-448e-a05c-211f5f8f0e6b', '6e639ace-010e-483d-8efd-8dfb6126e687', '6e0c5133-9bbb-43ba-afbe-dc6b12f4c346', '05a04ed3-7178-41cd-b7fd-4588ea305d84'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:05 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:05 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-7d366aa0-eb0c-4115-a350-edc3870805d6-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "cinder-7d366aa0-eb0c-4115-a350-edc3870805d6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-7d366aa0-eb0c-4115-a350-edc3870805d6" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-7d366aa0-eb0c-4115-a350-edc3870805d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:05 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb4598-75d8-46ea-9b91-a0c1aaa04390]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "cinder-quobyte-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb" released by "delete_volume" :: held 0.977s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Created reservations ['2744fa10-d133-4715-8a60-1d2406da7828', '9d161e9d-a49c-4d62-8a4a-4ea30941f411', '7774a0b0-f4ed-4a47-b603-6f83931fee41', 'd80161fd-d937-4af6-bd89-c3e38c736cff'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:06 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:55:06 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:06 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:06 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:06 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8fb3826-4b5a-4bbb-9daa-b835776cdf00 tempest-VolumesGetTest-1297157311 None] Lock "cinder-183fb977-3d96-47ed-a860-6a9dd67e2857-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:06 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:06 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Deleted volume successfully. Apr 14 03:55:06 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6 Apr 14 03:55:06 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-825c0083-73a6-410d-81c6-1e5b8e50affe tempest-AbsoluteLimitsTests-1199784290 None] Lock "cinder-6ee48399-2cc9-4e6b-9835-3dbb338eb8bb-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:06 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d366aa0-eb0c-4115-a350-edc3870805d6" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-7d366aa0-eb0c-4115-a350-edc3870805d6" released by "delete_volume" :: held 0.934s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Created reservations ['7454573f-10c8-4d0f-9381-f5fe5a8944ff', '4d45d07b-ff99-4b0e-aad6-bf2a16bf611c', 'bf63ad89-aee0-4cfb-8f62-1e44e7298a74', 'b9aebe19-d93f-49e3-9677-a68228cd7ac8'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:06 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:06 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:07 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.456s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:07 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f2885748-f2f1-4752-aa1f-e23a5fc5c77b tempest-VolumesGetTest-1297157311 None] Lock "cinder-7d366aa0-eb0c-4115-a350-edc3870805d6-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (afb572c4-d3d5-4398-bc90-921c8359a1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e37b434-ab91-4ec4-a598-66dd973a4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e37b434-ab91-4ec4-a598-66dd973a4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-25064987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a7c370-d968-45bc-8672-c89cb189ae52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:08Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ea3fb-ab9c-4e3b-9019-b0f16fd6bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ea3fb-ab9c-4e3b-9019-b0f16fd6bb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a288f156-7025-4917-8c50-45fd544f268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.image.glance [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Creating Keystone auth plugin from conf {{(pid=82370) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a288f156-7025-4917-8c50-45fd544f268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08a7c370-d968-45bc-8672-c89cb189ae52', 'volume_name': 'volume-08a7c370-d968-45bc-8672-c89cb189ae52', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a0118a-ff7e-4972-80ba-98bb6c9e3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a0118a-ff7e-4972-80ba-98bb6c9e3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6981e2fd-2551-43d8-80b3-17bff0135ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Volume 08a7c370-d968-45bc-8672-c89cb189ae52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08a7c370-d968-45bc-8672-c89cb189ae52', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:55:07 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Trying to clone 08a7c370-d968-45bc-8672-c89cb189ae52 from image 561c6fea-555e-40c4-aed9-ba813c6be050 at location (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]). {{(pid=82370) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:55:08 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e6efa-bb2b-456e-bd48-e58fef55f2a3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:08 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD Apr 14 03:55:08 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:08 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 is fetched for user 6dfe771bc6f14aa489d19800fb6ee166. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9b6fe-6ac2-468c-98cc-c3088e7a5169]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:08 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD Apr 14 03:55:08 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:09 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-25064987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a7c370-d968-45bc-8672-c89cb189ae52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:08Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Creating volume 08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:09 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:09 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1073741824 Apr 14 03:55:09 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:09 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1073741824" returned: 0 in 0.522s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:09 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:09 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:10 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Attempting download of 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 08a7c370-d968-45bc-8672-c89cb189ae52. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Flow 'volume_create_manager' (7b2382aa-d665-400d-810b-7655dbe47f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828d94d4-2a7b-4c94-bf41-2606f4d6c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adf5a51-d82b-4fd9-a5c8-408c06d29e25]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828d94d4-2a7b-4c94-bf41-2606f4d6c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2046207383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadc88a8-4639-42cb-a613-5fb97e179135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d6324cc414803be39e43902fa6563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:10Z,use_quota=True,user_id='4adb81afed054f86b580e0e9f2a3c2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ea9299-080a-4ae2-b3d0-849475a2a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ea9299-080a-4ae2-b3d0-849475a2a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c056903-44bf-4cbd-9445-b9ccff590b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c056903-44bf-4cbd-9445-b9ccff590b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadc88a8-4639-42cb-a613-5fb97e179135', 'volume_name': 'volume-fadc88a8-4639-42cb-a613-5fb97e179135', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e8d0a0-d63e-472d-96bb-6c7afa3b14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e8d0a0-d63e-472d-96bb-6c7afa3b14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73840852-afb8-4d3f-8461-c5dfe78c1536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Volume fadc88a8-4639-42cb-a613-5fb97e179135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadc88a8-4639-42cb-a613-5fb97e179135', 'volume_size': 1} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2046207383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadc88a8-4639-42cb-a613-5fb97e179135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d6324cc414803be39e43902fa6563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:10Z,use_quota=True,user_id='4adb81afed054f86b580e0e9f2a3c2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Creating volume fadc88a8-4639-42cb-a613-5fb97e179135 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:10 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:10 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 1073741824 Apr 14 03:55:10 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:10 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg Apr 14 03:55:10 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:10 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg" returned: 0 in 0.497s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:10 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 1073741824" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:10 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg Apr 14 03:55:10 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:10 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 Apr 14 03:55:10 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:11 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg" returned: 1 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_9uaydvvg' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bba2994-d816-46bf-800d-0aade8af1e21]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:11 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135" returned: 0 in 0.419s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73840852-afb8-4d3f-8461-c5dfe78c1536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadc88a8-4639-42cb-a613-5fb97e179135', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffac5f4f-0094-49b3-9943-3976e16ba524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Volume volume-fadc88a8-4639-42cb-a613-5fb97e179135 (fadc88a8-4639-42cb-a613-5fb97e179135): created successfully Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffac5f4f-0094-49b3-9943-3976e16ba524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Flow 'volume_create_manager' (7b2382aa-d665-400d-810b-7655dbe47f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:11 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-666a4a82-ca46-4218-866a-251ee74bedde tempest-VolumesTransfersV355Test-908186602 None] Created volume successfully. Apr 14 03:55:11 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD Apr 14 03:55:11 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:11 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] 561c6fea-555e-40c4-aed9-ba813c6be050 was qcow2, converting to raw {{(pid=82370) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:55:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:11 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:11 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:12 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 0 in 0.876s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:12 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_4ujjtn0ydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:55:12 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Converted 112.00 MB image at 112.00 MB/s Apr 14 03:55:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:12 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1G Apr 14 03:55:12 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-858f7b29-739f-4eb3-94f8-51822a804b46 tempest-VolumesTransfersV355Test-1624376731 None] Transfer volume completed successfully. Apr 14 03:55:13 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 1G" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b4690-4ca1-4c71-b91a-1f7640ec616f]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:13 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:13 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "cinder-fadc88a8-4639-42cb-a613-5fb97e179135-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-fadc88a8-4639-42cb-a613-5fb97e179135-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:13 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "cinder-quobyte-fadc88a8-4639-42cb-a613-5fb97e179135" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-quobyte-fadc88a8-4639-42cb-a613-5fb97e179135" acquired by "delete_volume" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad78f311-487f-4d97-abe7-31b228905216]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:13 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:13 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:13 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 Apr 14 03:55:13 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:14 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 1 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Downloaded image 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 08a7c370-d968-45bc-8672-c89cb189ae52 successfully. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 for user 6dfe771bc6f14aa489d19800fb6ee166 is deleted. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Marking volume 08a7c370-d968-45bc-8672-c89cb189ae52 as bootable. {{(pid=82370) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Copying metadata from image 561c6fea-555e-40c4-aed9-ba813c6be050 to 08a7c370-d968-45bc-8672-c89cb189ae52. {{(pid=82370) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Creating volume glance metadata for volume 08a7c370-d968-45bc-8672-c89cb189ae52 backed by image 561c6fea-555e-40c4-aed9-ba813c6be050 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82370) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:55:14 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:14 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135 Apr 14 03:55:14 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6981e2fd-2551-43d8-80b3-17bff0135ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a7c370-d968-45bc-8672-c89cb189ae52', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b654493-3bfa-4da3-b80c-6e3ab5fa852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:14 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Volume volume-08a7c370-d968-45bc-8672-c89cb189ae52 (08a7c370-d968-45bc-8672-c89cb189ae52): created successfully Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b654493-3bfa-4da3-b80c-6e3ab5fa852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (afb572c4-d3d5-4398-bc90-921c8359a1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-22dd8e0c-7fdd-4f45-81a9-61d181749022 tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:55:14 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-fadc88a8-4639-42cb-a613-5fb97e179135" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-quobyte-fadc88a8-4639-42cb-a613-5fb97e179135" released by "delete_volume" :: held 0.914s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Created reservations ['c7c691e8-9487-4b21-aed7-47f7b9c892f5', 'aa5589d6-d31b-4fea-acf6-4a6c1e90e898', 'd6140d45-cc95-487a-bd86-603117dea9f1', '166b428f-03c1-40f5-8733-5dd45e62c074'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:14 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:14 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Flow 'volume_create_manager' (5c0c0b13-fe85-4680-a4ff-7810f7bb2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0050d47-476a-413a-9ea0-cd79165c53f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0050d47-476a-413a-9ea0-cd79165c53f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187323614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8980080-c82f-410c-bb48-33e5f5798e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d6324cc414803be39e43902fa6563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:15Z,use_quota=True,user_id='4adb81afed054f86b580e0e9f2a3c2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5fdff2-07c6-4145-b05e-82a75558c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5fdff2-07c6-4145-b05e-82a75558c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12626c5-4b16-43fb-9d38-9ef042e2fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12626c5-4b16-43fb-9d38-9ef042e2fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8980080-c82f-410c-bb48-33e5f5798e24', 'volume_name': 'volume-c8980080-c82f-410c-bb48-33e5f5798e24', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3195975-cc0f-41d3-899d-5c5efd35e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3195975-cc0f-41d3-899d-5c5efd35e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368e6de5-729c-4524-a061-acde7a842b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Volume c8980080-c82f-410c-bb48-33e5f5798e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8980080-c82f-410c-bb48-33e5f5798e24', 'volume_size': 1} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187323614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8980080-c82f-410c-bb48-33e5f5798e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d6324cc414803be39e43902fa6563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:15Z,use_quota=True,user_id='4adb81afed054f86b580e0e9f2a3c2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Creating volume c8980080-c82f-410c-bb48-33e5f5798e24 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:15 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:15 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 1073741824 Apr 14 03:55:15 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:15 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Deleted volume successfully. Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4e48ec6d-d014-4961-babf-88d79869b3f5 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-fadc88a8-4639-42cb-a613-5fb97e179135-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (8de3c7ce-dbd7-4356-b69c-24f325791b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ed71e2-7e8c-4805-9bd9-a54502921bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ed71e2-7e8c-4805-9bd9-a54502921bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-822138442',display_name='tempest-VolumesGetTest-Volume-1948293752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f8b52e-946a-4d75-802c-d997093298f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:15Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779186ef-4b86-4e19-9707-fecf2c51782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779186ef-4b86-4e19-9707-fecf2c51782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed6043-42d4-4d56-9eeb-ea43f07f5b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed6043-42d4-4d56-9eeb-ea43f07f5b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f8b52e-946a-4d75-802c-d997093298f1', 'volume_name': 'volume-d1f8b52e-946a-4d75-802c-d997093298f1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b5410-9e18-4f4c-88b4-a31e8fc34af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b5410-9e18-4f4c-88b4-a31e8fc34af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e620df-3526-47e7-8870-835992b9b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Volume d1f8b52e-946a-4d75-802c-d997093298f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f8b52e-946a-4d75-802c-d997093298f1', 'volume_size': 1} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:15 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 1073741824" returned: 0 in 0.526s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:15 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 Apr 14 03:55:15 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:15 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-822138442',display_name='tempest-VolumesGetTest-Volume-1948293752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f8b52e-946a-4d75-802c-d997093298f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c53c26df3a40cb88196d57fd9b4744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:15Z,use_quota=True,user_id='6dfe771bc6f14aa489d19800fb6ee166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Creating volume d1f8b52e-946a-4d75-802c-d997093298f1 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:16 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368e6de5-729c-4524-a061-acde7a842b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8980080-c82f-410c-bb48-33e5f5798e24', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec096574-e1a1-431b-b534-6bbe05e898dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:16 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 1073741824 Apr 14 03:55:16 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Volume volume-c8980080-c82f-410c-bb48-33e5f5798e24 (c8980080-c82f-410c-bb48-33e5f5798e24): created successfully Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec096574-e1a1-431b-b534-6bbe05e898dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Flow 'volume_create_manager' (5c0c0b13-fe85-4680-a4ff-7810f7bb2151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d3339bb5-616d-4f48-b9f5-528aa2cd2b08 tempest-VolumesTransfersV355Test-908186602 None] Created volume successfully. Apr 14 03:55:16 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 1073741824" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:16 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 Apr 14 03:55:16 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:16 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e620df-3526-47e7-8870-835992b9b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f8b52e-946a-4d75-802c-d997093298f1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fd561a-da80-4563-bfec-3d230bee3c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Volume volume-d1f8b52e-946a-4d75-802c-d997093298f1 (d1f8b52e-946a-4d75-802c-d997093298f1): created successfully Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fd561a-da80-4563-bfec-3d230bee3c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Flow 'volume_create_manager' (8de3c7ce-dbd7-4356-b69c-24f325791b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ad7cbe59-6ecd-43a9-a480-9027834149fe tempest-VolumesGetTest-1297157311 None] Created volume successfully. Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "cinder-c8980080-c82f-410c-bb48-33e5f5798e24-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-c8980080-c82f-410c-bb48-33e5f5798e24-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "cinder-quobyte-c8980080-c82f-410c-bb48-33e5f5798e24" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-quobyte-c8980080-c82f-410c-bb48-33e5f5798e24" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b72954-074e-46a8-b53a-3addf93c088e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:17 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 Apr 14 03:55:17 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-d1f8b52e-946a-4d75-802c-d997093298f1-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "cinder-d1f8b52e-946a-4d75-802c-d997093298f1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-d1f8b52e-946a-4d75-802c-d997093298f1" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-d1f8b52e-946a-4d75-802c-d997093298f1" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0689e-9349-400d-af6b-4689a9a4cf39]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:17 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 Apr 14 03:55:17 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:17 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:17 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24 Apr 14 03:55:17 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:18 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:18 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1 Apr 14 03:55:18 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:18 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c8980080-c82f-410c-bb48-33e5f5798e24" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-quobyte-c8980080-c82f-410c-bb48-33e5f5798e24" released by "delete_volume" :: held 0.920s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Created reservations ['f447c1b7-6571-457c-970f-5ff324e43515', 'f86e64ef-0553-4ae0-9c35-c9fd80cd1f2f', '8ec0539f-1993-4ca9-8a9b-761e3d765bf2', 'd08bcd46-b529-43c3-9eed-023fa792959c'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:18 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:18 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:18 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-d1f8b52e-946a-4d75-802c-d997093298f1" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-d1f8b52e-946a-4d75-802c-d997093298f1" released by "delete_volume" :: held 0.917s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Created reservations ['50f86cd4-88e6-4780-8881-235a1937bfa3', '1347fc65-fdf6-49d7-ae35-fbb18c7bbad7', 'e0205bd7-f3fb-4c2c-b48b-427d3421a777', 'f22a93cd-0947-41eb-8fa0-fc9583831b10'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:18 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:18 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-08a7c370-d968-45bc-8672-c89cb189ae52-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:18 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.561s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "cinder-08a7c370-d968-45bc-8672-c89cb189ae52-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:18 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Deleted volume successfully. Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Acquiring lock "cinder-quobyte-08a7c370-d968-45bc-8672-c89cb189ae52" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-f5894952-9e30-4344-ae67-33f07c4eaba2 tempest-VolumesTransfersV355Test-24813027 None] Lock "cinder-c8980080-c82f-410c-bb48-33e5f5798e24-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-08a7c370-d968-45bc-8672-c89cb189ae52" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f1aea-3959-457f-8e80-6b17c4cc0d95]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:18 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:18 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:19 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:19 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:55:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4cca206e-9b94-4387-bb2a-32ba139868dc tempest-VolumesGetTest-1297157311 None] Lock "cinder-d1f8b52e-946a-4d75-802c-d997093298f1-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:19 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 0 in 0.531s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:19 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:19 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:20 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 1 in 0.567s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:20 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52 Apr 14 03:55:20 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:20 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-08a7c370-d968-45bc-8672-c89cb189ae52" returned: 0 in 0.441s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "cinder-quobyte-08a7c370-d968-45bc-8672-c89cb189ae52" released by "delete_volume" :: held 1.584s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Created reservations ['89425ae8-f55f-4b74-a18d-618922bf46fb', '64e5d2ce-a518-41bb-9f20-607e33685e2d', '947e76a7-371d-4f92-9320-6c8e8404a78a', '42dce470-925d-4d90-8211-2ca8823a98e6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:20 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:20 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:21 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:21 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Deleted volume successfully. Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-75bd8020-3eb2-44ad-a89b-ebbc543a41e2 tempest-VolumesGetTest-1297157311 None] Lock "cinder-08a7c370-d968-45bc-8672-c89cb189ae52-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Flow 'volume_create_manager' (509ab052-8a60-40c8-b303-2b6c65bd485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c638d353-83fe-41cd-a362-7a20374418b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c638d353-83fe-41cd-a362-7a20374418b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-8675017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f6831f-b381-46d2-8c61-919bbc558be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc7c4a778314fbca8d51ab968bfe721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:22Z,use_quota=True,user_id='597c0fd81fb64bb1a57915f213dbb88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b75362a-5207-4366-9846-2ef552651b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b75362a-5207-4366-9846-2ef552651b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3dab6a-570a-4443-a2e2-b0bfaae7f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.image.glance [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Creating Keystone auth plugin from conf {{(pid=82370) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3dab6a-570a-4443-a2e2-b0bfaae7f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39f6831f-b381-46d2-8c61-919bbc558be6', 'volume_name': 'volume-39f6831f-b381-46d2-8c61-919bbc558be6', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c899908-f270-488b-8616-d0b469d25fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c899908-f270-488b-8616-d0b469d25fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22935a39-d12f-481f-80d7-c79b936f569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:21 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Volume 39f6831f-b381-46d2-8c61-919bbc558be6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39f6831f-b381-46d2-8c61-919bbc558be6', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:55:21 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Trying to clone 39f6831f-b381-46d2-8c61-919bbc558be6 from image 561c6fea-555e-40c4-aed9-ba813c6be050 at location (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]). {{(pid=82370) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:55:22 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ce22f-868a-48a2-a8d6-36719d6f2396]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:22 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD Apr 14 03:55:22 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:22 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 is fetched for user 597c0fd81fb64bb1a57915f213dbb88c. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3960891-c11c-4c04-8da2-ba278f746649]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (44bd9d50-2f23-49af-9404-06cab0844202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc37f947-278a-410d-be82-c0be2c8bb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc37f947-278a-410d-be82-c0be2c8bb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99162109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6337073-168f-4fa7-9228-59d00bec95c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:23Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:22 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD Apr 14 03:55:22 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76227d65-b063-4152-95ab-fa7220b2ca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76227d65-b063-4152-95ab-fa7220b2ca59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9629e-b8c4-466f-96e9-9bb1be9e06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9629e-b8c4-466f-96e9-9bb1be9e06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6337073-168f-4fa7-9228-59d00bec95c9', 'volume_name': 'volume-e6337073-168f-4fa7-9228-59d00bec95c9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7299c5b5-1dd6-444d-af6b-4d41b87eef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7299c5b5-1dd6-444d-af6b-4d41b87eef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b6e845-3b94-4cd6-8bdb-6fcd8f97aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:22 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Volume e6337073-168f-4fa7-9228-59d00bec95c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6337073-168f-4fa7-9228-59d00bec95c9', 'volume_size': 1} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99162109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6337073-168f-4fa7-9228-59d00bec95c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:23Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Creating volume e6337073-168f-4fa7-9228-59d00bec95c9 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:22 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:22 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 1073741824 Apr 14 03:55:22 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:23 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:23 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 1073741824" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:23 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 Apr 14 03:55:23 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:23 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9" returned: 0 in 0.397s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-8675017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f6831f-b381-46d2-8c61-919bbc558be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc7c4a778314fbca8d51ab968bfe721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:22Z,use_quota=True,user_id='597c0fd81fb64bb1a57915f213dbb88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Creating volume 39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:23 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b6e845-3b94-4cd6-8bdb-6fcd8f97aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6337073-168f-4fa7-9228-59d00bec95c9', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:23 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1073741824 Apr 14 03:55:23 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69561e6-faf4-401a-94d1-82c8fbf41ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:23 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Volume volume-e6337073-168f-4fa7-9228-59d00bec95c9 (e6337073-168f-4fa7-9228-59d00bec95c9): created successfully Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69561e6-faf4-401a-94d1-82c8fbf41ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (44bd9d50-2f23-49af-9404-06cab0844202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:23 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3a07be39-fb65-46e8-a513-f0cb9fe0fce4 tempest-VolumesListTestJSON-843413570 None] Created volume successfully. Apr 14 03:55:24 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1073741824" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:24 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:24 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:24 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.402s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Attempting download of 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 39f6831f-b381-46d2-8c61-919bbc558be6. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c23cf-fe79-45d6-be53-897f76ddd1e9]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:24 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj Apr 14 03:55:24 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (9abf67cc-e644-49a9-ab52-f1183d4a8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28e41f-c89f-4778-8f42-ee269ae91273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28e41f-c89f-4778-8f42-ee269ae91273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1658479550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3206411c-f092-4203-a72b-2e566f3ac924,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:25Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2c1b0-312d-499e-994d-63d0f068bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2c1b0-312d-499e-994d-63d0f068bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e895458-e907-41cb-b7a5-1f78726d379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:25 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e895458-e907-41cb-b7a5-1f78726d379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3206411c-f092-4203-a72b-2e566f3ac924', 'volume_name': 'volume-3206411c-f092-4203-a72b-2e566f3ac924', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26418b-476b-41e5-9ebb-fc828e91c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26418b-476b-41e5-9ebb-fc828e91c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e6787-e67c-45ed-bea8-2b8ee3258968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Volume 3206411c-f092-4203-a72b-2e566f3ac924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3206411c-f092-4203-a72b-2e566f3ac924', 'volume_size': 1} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1658479550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3206411c-f092-4203-a72b-2e566f3ac924,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:25Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Creating volume 3206411c-f092-4203-a72b-2e566f3ac924 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj" returned: 0 in 0.534s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:25 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 1073741824 Apr 14 03:55:25 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:25 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj Apr 14 03:55:25 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:25 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 1073741824" returned: 0 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:25 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj" returned: 1 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_561c6fea-555e-40c4-aed9-ba813c6be050_bs6kaecj' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab645bd1-436a-44bc-833d-d34911e0ab63]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:25 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 Apr 14 03:55:25 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:25 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD Apr 14 03:55:25 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:26 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e6787-e67c-45ed-bea8-2b8ee3258968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3206411c-f092-4203-a72b-2e566f3ac924', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0b8747-eaec-47ec-91cf-014cdedef195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Volume volume-3206411c-f092-4203-a72b-2e566f3ac924 (3206411c-f092-4203-a72b-2e566f3ac924): created successfully Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0b8747-eaec-47ec-91cf-014cdedef195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (9abf67cc-e644-49a9-ab52-f1183d4a8758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-20950d85-7524-4602-a0fc-8e0c4f832d16 tempest-VolumesListTestJSON-843413570 None] Created volume successfully. Apr 14 03:55:26 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] 561c6fea-555e-40c4-aed9-ba813c6be050 was qcow2, converting to raw {{(pid=82370) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:26 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:26 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:26 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.811s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_561c6fea-555e-40c4-aed9-ba813c6be050_f7nht6fbdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:55:26 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Converted 112.00 MB image at 112.00 MB/s Apr 14 03:55:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:27 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1G Apr 14 03:55:27 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:27 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 1G" returned: 0 in 0.446s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278d624-6faf-4c03-9f2d-0e64b602521f]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (c5f1319d-24f4-453e-9459-bcb0ed0f47a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe12783-6268-457d-a132-ddd5f0ea0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe12783-6268-457d-a132-ddd5f0ea0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1375282695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e07fcc0-5c7e-435c-9401-3ff420b1bafb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:27Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeb593c-4f07-4911-9b75-e45729e02ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeb593c-4f07-4911-9b75-e45729e02ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:27 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:27 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f31f444-71c2-44d0-884a-ff922036d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f31f444-71c2-44d0-884a-ff922036d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e07fcc0-5c7e-435c-9401-3ff420b1bafb', 'volume_name': 'volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96489bd9-98e4-4d08-8c1e-c3b6186c8081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96489bd9-98e4-4d08-8c1e-c3b6186c8081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcd5f56-962e-4843-9946-fe537343c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Volume 3e07fcc0-5c7e-435c-9401-3ff420b1bafb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb', 'volume_size': 1} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1375282695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e07fcc0-5c7e-435c-9401-3ff420b1bafb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83631b13b1714e1c9e813624e80aa6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:27Z,use_quota=True,user_id='7e21247204b649cbb60bc3b14ffd1962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Creating volume 3e07fcc0-5c7e-435c-9401-3ff420b1bafb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:27 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:27 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb 1073741824 Apr 14 03:55:27 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:27 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.494s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:28 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:28 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:28 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb 1073741824" returned: 0 in 0.489s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:28 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb Apr 14 03:55:28 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:28 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 1 in 0.463s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Downloaded image 561c6fea-555e-40c4-aed9-ba813c6be050 ((None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}])) to volume 39f6831f-b381-46d2-8c61-919bbc558be6 successfully. {{(pid=82370) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Temporary image 561c6fea-555e-40c4-aed9-ba813c6be050 for user 597c0fd81fb64bb1a57915f213dbb88c is deleted. {{(pid=82370) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.volume_utils [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Marking volume 39f6831f-b381-46d2-8c61-919bbc558be6 as bootable. {{(pid=82370) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Copying metadata from image 561c6fea-555e-40c4-aed9-ba813c6be050 to 39f6831f-b381-46d2-8c61-919bbc558be6. {{(pid=82370) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Creating volume glance metadata for volume 39f6831f-b381-46d2-8c61-919bbc558be6 backed by image 561c6fea-555e-40c4-aed9-ba813c6be050 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82370) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:55:28 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22935a39-d12f-481f-80d7-c79b936f569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f6831f-b381-46d2-8c61-919bbc558be6', 'volume_size': 1, 'image_id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/561c6fea-555e-40c4-aed9-ba813c6be050', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '605a12854bd943918df1110d4003479b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '561c6fea-555e-40c4-aed9-ba813c6be050', 'created_at': datetime.datetime(2026, 4, 14, 1, 44, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 1, 44, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/561c6fea-555e-40c4-aed9-ba813c6be050/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34486036-7e25-4b7a-ad94-b88e6e990dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcd5f56-962e-4843-9946-fe537343c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3c676-71d2-49c6-833d-733043e05162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:28 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Volume volume-39f6831f-b381-46d2-8c61-919bbc558be6 (39f6831f-b381-46d2-8c61-919bbc558be6): created successfully Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34486036-7e25-4b7a-ad94-b88e6e990dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Flow 'volume_create_manager' (509ab052-8a60-40c8-b303-2b6c65bd485c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:28 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Volume volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb (3e07fcc0-5c7e-435c-9401-3ff420b1bafb): created successfully Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3c676-71d2-49c6-833d-733043e05162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Flow 'volume_create_manager' (c5f1319d-24f4-453e-9459-bcb0ed0f47a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-db1298a7-8dac-46ea-bb5d-5282c30972ea tempest-VolumesExtendTest-186813416 None] Created volume successfully. Apr 14 03:55:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6bb7e4e0-c084-4c0f-a83d-e3affb8b422e tempest-VolumesListTestJSON-843413570 None] Created volume successfully. Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7655a973-e213-4a4b-ac8d-7d6113853a72]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:29 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:29 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:29 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.467s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:29 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:29 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:30 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 1 in 0.521s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 2G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 2G" returned: 0 in 0.045s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.061s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:30 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8e99a422-ae41-4be8-b30c-9e094f4331fd tempest-VolumesExtendTest-186813416 None] Extend volume completed successfully. Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-3e07fcc0-5c7e-435c-9401-3ff420b1bafb-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-3e07fcc0-5c7e-435c-9401-3ff420b1bafb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-quobyte-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" acquired by "delete_volume" :: waited 0.024s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8a3e0a-80bb-4a2f-9f56-5d1108e6b96d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:31 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb Apr 14 03:55:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-39f6831f-b381-46d2-8c61-919bbc558be6-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "cinder-39f6831f-b381-46d2-8c61-919bbc558be6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-quobyte-39f6831f-b381-46d2-8c61-919bbc558be6" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-39f6831f-b381-46d2-8c61-919bbc558be6" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb3e14-dfe4-43a9-9796-b4fbc76d7f0a]: (4, 'raw') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:31 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:31 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:31 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:31 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb Apr 14 03:55:31 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:31 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:32 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:32 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:32 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-3e07fcc0-5c7e-435c-9401-3ff420b1bafb" released by "delete_volume" :: held 0.929s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Created reservations ['279d9a43-5a5b-474d-9795-0ecc1e12cdc4', '2ed0d4bc-e564-4bae-badd-aeeb75236ee1', 'c5a5934e-173b-4b85-9949-899b78642d04', 'f58ee104-a063-4f56-b213-a58a84e37a57'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:32 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:32 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-3206411c-f092-4203-a72b-2e566f3ac924-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-3206411c-f092-4203-a72b-2e566f3ac924-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-quobyte-3206411c-f092-4203-a72b-2e566f3ac924" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-3206411c-f092-4203-a72b-2e566f3ac924" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12514f-47d9-422f-ae1c-635aa714e21b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:32 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 1 in 0.530s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6' failed. Not Retrying. {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:32 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6 Apr 14 03:55:32 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:32 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 Apr 14 03:55:32 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:32 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.430s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Deleted volume successfully. Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-263f3ed4-1838-4321-979a-843b93d87e01 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-3e07fcc0-5c7e-435c-9401-3ff420b1bafb-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:32 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:32 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-39f6831f-b381-46d2-8c61-919bbc558be6" returned: 0 in 0.439s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:32 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924 Apr 14 03:55:32 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-39f6831f-b381-46d2-8c61-919bbc558be6" released by "delete_volume" :: held 1.476s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:32 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Created reservations ['c5b38da8-1981-462d-b091-455c2b53dfd2', '9360bbcb-0909-4ce6-8444-0f503ecee481', '41bf98e0-787d-42e9-bbb5-415f730ae1aa', 'e6dec732-fbde-49d5-8884-cb0548385486'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:33 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:33 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:33 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3206411c-f092-4203-a72b-2e566f3ac924" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-3206411c-f092-4203-a72b-2e566f3ac924" released by "delete_volume" :: held 0.908s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Created reservations ['aed8d9aa-d92a-40ff-94a3-e0975e394cdb', '5ffe038a-9d9c-43f4-9cbe-5aed899d630c', 'deff039a-4c0b-47f5-b4b6-fa2417f0e15e', '08d212b3-b111-4d17-94f0-ab842f39ba5a'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:33 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Deleted volume successfully. Apr 14 03:55:33 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:33 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-8aaeee3a-4a38-4c4d-9aff-093877fbbd4a tempest-VolumesExtendTest-186813416 None] Lock "cinder-39f6831f-b381-46d2-8c61-919bbc558be6-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-e6337073-168f-4fa7-9228-59d00bec95c9-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "cinder-e6337073-168f-4fa7-9228-59d00bec95c9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Acquiring lock "cinder-quobyte-e6337073-168f-4fa7-9228-59d00bec95c9" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:33 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Deleted volume successfully. Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Flow 'volume_create_manager' (277a77ae-6dd2-4965-a474-99377da6718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd617333-f875-43b7-93ca-a273140038fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-e6337073-168f-4fa7-9228-59d00bec95c9" acquired by "delete_volume" :: waited 0.064s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[096eef52-83a9-469e-a433-5f0261ea20dd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd617333-f875-43b7-93ca-a273140038fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1281210037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc4a2c5-f400-4a19-824d-70bd1d333a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc7c4a778314fbca8d51ab968bfe721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:34Z,use_quota=True,user_id='597c0fd81fb64bb1a57915f213dbb88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c9d650-1270-4213-a930-9280d904bac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c9d650-1270-4213-a930-9280d904bac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29a00cf-0f53-4102-b719-f69ba0e4155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29a00cf-0f53-4102-b719-f69ba0e4155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc4a2c5-f400-4a19-824d-70bd1d333a61', 'volume_name': 'volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cabcfd4-79c2-4e5e-bcc2-ca3eaf34602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cabcfd4-79c2-4e5e-bcc2-ca3eaf34602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffc6e5-c6cf-4d7a-aa3b-757819f14516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:33 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Volume 4cc4a2c5-f400-4a19-824d-70bd1d333a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61', 'volume_size': 1} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1281210037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc4a2c5-f400-4a19-824d-70bd1d333a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc7c4a778314fbca8d51ab968bfe721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:34Z,use_quota=True,user_id='597c0fd81fb64bb1a57915f213dbb88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Creating volume 4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:33 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-beea5bdd-8aa0-4f3a-9b13-c30d035573e8 tempest-VolumesListTestJSON-843413570 None] Lock "cinder-3206411c-f092-4203-a72b-2e566f3ac924-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:33 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 Apr 14 03:55:33 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:33 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 1073741824 Apr 14 03:55:33 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:34 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:34 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9 Apr 14 03:55:34 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:34 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 1073741824" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:34 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:34 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:34 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e6337073-168f-4fa7-9228-59d00bec95c9" returned: 0 in 0.404s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "cinder-quobyte-e6337073-168f-4fa7-9228-59d00bec95c9" released by "delete_volume" :: held 0.909s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Created reservations ['8232e95a-ffdd-47b5-a882-ca07ed879e56', 'ddfe5786-92e8-4d1b-87c6-667d3c208293', 'ed57db37-7d57-41c5-95ab-2db2b1cb1ef7', 'cc668b6c-ea37-4381-9ae2-7f6819dc335b'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:34 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.442s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:34 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:34 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffc6e5-c6cf-4d7a-aa3b-757819f14516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e4f2e4-006e-48e3-b7d3-710974a0d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:34 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Volume volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 (4cc4a2c5-f400-4a19-824d-70bd1d333a61): created successfully Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e4f2e4-006e-48e3-b7d3-710974a0d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:34 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Flow 'volume_create_manager' (277a77ae-6dd2-4965-a474-99377da6718c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-16e078a8-1d39-47b2-90e0-9e6566120070 tempest-VolumesExtendTest-186813416 None] Created volume successfully. Apr 14 03:55:35 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:35 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Deleted volume successfully. Apr 14 03:55:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-3602e85a-72de-4f1f-85dd-6bc92a09de3f tempest-VolumesListTestJSON-843413570 None] Lock "cinder-e6337073-168f-4fa7-9228-59d00bec95c9-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:35 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=238,cinder:SELECT=160,cinder:INSERT=67,cinder:DELETE=24 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Creating offline snapshot 83a29216-2c40-4c6d-892a-0dfb354bd160 of volume 4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b67cf-1151-44ee-b352-c6bc348de81a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:36 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:36 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (f724d423-82c4-42d0-aee9-dcd91be00e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e347d8c-cea0-4385-a0ae-cef285c4b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e347d8c-cea0-4385-a0ae-cef285c4b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218934926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bc49f3-4336-4a3d-a3c8-89de5f0fae21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:36Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de82cdf-31e5-4348-9529-d780c1eded1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de82cdf-31e5-4348-9529-d780c1eded1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c5ef48-625a-4657-a2db-6231ec247141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c5ef48-625a-4657-a2db-6231ec247141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bc49f3-4336-4a3d-a3c8-89de5f0fae21', 'volume_name': 'volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0e559e-eebb-4a84-afdd-d1f8dca4d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0e559e-eebb-4a84-afdd-d1f8dca4d39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c987ca5-5bfd-439a-9088-f4fc2790735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:36 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume 84bc49f3-4336-4a3d-a3c8-89de5f0fae21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21', 'volume_size': 1} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:36 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:36 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 1G Apr 14 03:55:36 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:37 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 1G" returned: 0 in 0.452s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:37 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 Apr 14 03:55:37 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:37 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:37 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 is being set with open permissions: ugo+rw Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:37 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 Apr 14 03:55:37 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:37 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:DELETE=16,cinder:SELECT=161,cinder:UPDATE=215,cinder:INSERT=61 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:55:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:37 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info Apr 14 03:55:37 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:38 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:38 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info is being set with open permissions: ugo+rw Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:38 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info Apr 14 03:55:38 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:38 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.info" returned: 0 in 0.399s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218934926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bc49f3-4336-4a3d-a3c8-89de5f0fae21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:36Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume 84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:38 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:38 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 1073741824 Apr 14 03:55:38 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6d89af35-3ffb-416c-9a1d-9d99f223fde8 tempest-VolumesExtendTest-186813416 None] Create snapshot completed successfully Apr 14 03:55:39 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 1073741824" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:39 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 Apr 14 03:55:39 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:39 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" returned: 0 in 0.448s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.418s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c987ca5-5bfd-439a-9088-f4fc2790735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7783d5ba-7ac1-425f-94b5-a52e9c573518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b96f40-3d2c-479c-9de7-7d509aca967a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:39 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 (84bc49f3-4336-4a3d-a3c8-89de5f0fae21): created successfully Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7783d5ba-7ac1-425f-94b5-a52e9c573518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:39 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (f724d423-82c4-42d0-aee9-dcd91be00e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5d7d937a-50f1-4520-96dd-1a08f22cbbf0 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:39 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:39 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:40 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 2G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 2G" returned: 0 in 0.056s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.568s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:40 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-34340a82-a307-4d63-8110-ea6f0bbec675 tempest-VolumesExtendTest-186813416 None] Extend volume completed successfully. Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-83a29216-2c40-4c6d-892a-0dfb354bd160-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-83a29216-2c40-4c6d-892a-0dfb354bd160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-quobyte-83a29216-2c40-4c6d-892a-0dfb354bd160" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-83a29216-2c40-4c6d-892a-0dfb354bd160" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Deleting offline snapshot 83a29216-2c40-4c6d-892a-0dfb354bd160 of volume 4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] snapshot_file for this snap is: volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0c8beb-755b-4bcd-913e-51a24f16c0e2]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:40 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 Apr 14 03:55:40 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating offline snapshot 2d1db3bf-5701-4292-9b6e-e317704010f4 of volume 84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2273340-9687-406b-b499-32945b435c7d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:40 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 Apr 14 03:55:40 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:40 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99207df-963a-4169-9de4-71e0ebd3ef58]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:41 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:41 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:41 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:41 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 1G Apr 14 03:55:41 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:41 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.499s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:41 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 Apr 14 03:55:41 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:41 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 1G" returned: 0 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:41 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 Apr 14 03:55:41 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:41 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:42 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160 Apr 14 03:55:42 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:42 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4" returned: 0 in 0.435s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:42 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 is being set with open permissions: ugo+rw Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:42 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 Apr 14 03:55:42 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:42 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61.83a29216-2c40-4c6d-892a-0dfb354bd160" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-83a29216-2c40-4c6d-892a-0dfb354bd160" released by "_delete_snapshot" :: held 1.958s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" released by "delete_snapshot" :: held 1.969s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Created reservations ['6b7b38d0-9d8c-4bc8-aeb3-c2e2a1b48a29', '6a570456-7825-4b25-8e0c-3330c49a7fa6', '9b020aa2-2c6f-4bf1-8b14-5fdee6d248a4', '32e9d399-3057-4c3f-93ff-68db007cf17e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:42 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Delete snapshot completed successfully. Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-341c9715-fe14-41f5-8914-18dcb5618c22 tempest-VolumesExtendTest-186813416 None] Lock "cinder-83a29216-2c40-4c6d-892a-0dfb354bd160-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-4cc4a2c5-f400-4a19-824d-70bd1d333a61-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "cinder-4cc4a2c5-f400-4a19-824d-70bd1d333a61-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Acquiring lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:42 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e2ef5-da84-4925-96ce-6612aa57907a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:42 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info Apr 14 03:55:42 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:42 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:42 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:43 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info" returned: 0 in 0.440s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:43 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info is being set with open permissions: ugo+rw Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:43 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.485s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:43 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info Apr 14 03:55:43 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:43 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61 Apr 14 03:55:43 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:43 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.info" returned: 0 in 0.394s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:43 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4fe1e6e9-d4a6-42d3-9118-4270dbb7a65a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Create snapshot completed successfully Apr 14 03:55:43 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-4cc4a2c5-f400-4a19-824d-70bd1d333a61" returned: 0 in 0.418s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "cinder-quobyte-4cc4a2c5-f400-4a19-824d-70bd1d333a61" released by "delete_volume" :: held 0.941s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Created reservations ['380ddcf5-2c6a-4cad-829a-0f72e075adfd', 'f5624f8f-3bf8-48e5-a890-3f7718ab4745', 'd5fd3e4e-08a0-4aa8-8e10-a8fe588a562d', '363d7921-ca02-463c-8462-26e1f1fc257e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:43 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:43 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:44 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (47727da3-3ac4-449d-8f4b-07e01aa01424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad791ffa-47e4-452f-acb2-6c6190505e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad791ffa-47e4-452f-acb2-6c6190505e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485528152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80146bbd-5b20-4000-a1c1-2095d90dab86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d91073-fef2-4fc3-9081-c4f72b389d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d91073-fef2-4fc3-9081-c4f72b389d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a16746-4925-4292-b1e9-762d477746d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a16746-4925-4292-b1e9-762d477746d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80146bbd-5b20-4000-a1c1-2095d90dab86', 'volume_name': 'volume-80146bbd-5b20-4000-a1c1-2095d90dab86', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9668c890-8017-4e88-9035-e57868e0adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9668c890-8017-4e88-9035-e57868e0adf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30801299-8f06-4bd2-8988-fd1074bd9e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume 80146bbd-5b20-4000-a1c1-2095d90dab86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80146bbd-5b20-4000-a1c1-2095d90dab86', 'volume_size': 1} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485528152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80146bbd-5b20-4000-a1c1-2095d90dab86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume 80146bbd-5b20-4000-a1c1-2095d90dab86 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Deleted volume successfully. Apr 14 03:55:44 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 1073741824 Apr 14 03:55:44 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7370335f-189d-4f91-a381-ef4a15f696c1 tempest-VolumesExtendTest-186813416 None] Lock "cinder-4cc4a2c5-f400-4a19-824d-70bd1d333a61-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (6c30208f-bdb4-41ce-9450-259dc1d5f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e09e5e-0b00-4bc4-870f-742ec9231b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e09e5e-0b00-4bc4-870f-742ec9231b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474483337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45fb516-63b6-4f43-b1cb-768be6242c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff4dbd1-41e5-4204-a8fb-652fa52ec151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff4dbd1-41e5-4204-a8fb-652fa52ec151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc27cec2-b457-4981-8818-da5f5a84409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc27cec2-b457-4981-8818-da5f5a84409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45fb516-63b6-4f43-b1cb-768be6242c6a', 'volume_name': 'volume-e45fb516-63b6-4f43-b1cb-768be6242c6a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc5e8fe-e9dd-444e-b591-c751f4838d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc5e8fe-e9dd-444e-b591-c751f4838d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b281269-5f6b-4ae2-8ea9-f8f41f103488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume e45fb516-63b6-4f43-b1cb-768be6242c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45fb516-63b6-4f43-b1cb-768be6242c6a', 'volume_size': 1} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (142587b9-8332-4db8-85aa-bd525d5c4a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52c5b49-17f5-4373-b2f7-5e8bb2cfd060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52c5b49-17f5-4373-b2f7-5e8bb2cfd060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061603891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e124972c-b04a-4729-98ae-75a9ebac752c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e410321-a0c9-4b92-820b-c97411ad7207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e410321-a0c9-4b92-820b-c97411ad7207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e2fa9f-f28f-4a16-a5e9-3064d26da80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e2fa9f-f28f-4a16-a5e9-3064d26da80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e124972c-b04a-4729-98ae-75a9ebac752c', 'volume_name': 'volume-e124972c-b04a-4729-98ae-75a9ebac752c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7768b7f-4cf8-4a40-b072-2893b97bac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7768b7f-4cf8-4a40-b072-2893b97bac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d539a0-ba68-4cf5-90aa-92c700a46984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume e124972c-b04a-4729-98ae-75a9ebac752c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e124972c-b04a-4729-98ae-75a9ebac752c', 'volume_size': 1} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (079303ad-b20b-4ee8-9faf-8ec1bfddac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267683dc-f574-4afa-857e-e63a3557170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267683dc-f574-4afa-857e-e63a3557170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174126250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:45Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6922c05-892d-4c08-8d19-ebfc76807eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6922c05-892d-4c08-8d19-ebfc76807eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce8ffd-e702-437e-af8e-3e017b6a806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce8ffd-e702-437e-af8e-3e017b6a806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d', 'volume_name': 'volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186b31f0-e397-4341-8b30-9fbd04b52020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186b31f0-e397-4341-8b30-9fbd04b52020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a95d294-61af-41dd-8c15-59aea9950e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d', 'volume_size': 1} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:44 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 1073741824" returned: 0 in 0.707s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:44 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 Apr 14 03:55:44 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (8b1a61b2-e1ca-4555-8300-1c71a68cb078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1940a3ca-65ff-4240-96c5-fa7458f33972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1940a3ca-65ff-4240-96c5-fa7458f33972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109693052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4eb205-1dca-4060-bf42-a6633f1b625f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:45Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de985b4-ae0b-4292-829a-e6b3ca3b1f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:44 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de985b4-ae0b-4292-829a-e6b3ca3b1f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a712fa7-c5ce-498d-bcdb-68af70cb4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a712fa7-c5ce-498d-bcdb-68af70cb4bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4eb205-1dca-4060-bf42-a6633f1b625f', 'volume_name': 'volume-cd4eb205-1dca-4060-bf42-a6633f1b625f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3fe7cc-5365-4f18-9fe2-1b29339cfbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3fe7cc-5365-4f18-9fe2-1b29339cfbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff636089-87d4-47a9-bd46-fbc3da4bb05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume cd4eb205-1dca-4060-bf42-a6633f1b625f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4eb205-1dca-4060-bf42-a6633f1b625f', 'volume_size': 1} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:45 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86" returned: 0 in 0.450s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474483337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45fb516-63b6-4f43-b1cb-768be6242c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume e45fb516-63b6-4f43-b1cb-768be6242c6a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:45 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30801299-8f06-4bd2-8988-fd1074bd9e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80146bbd-5b20-4000-a1c1-2095d90dab86', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a 1073741824 Apr 14 03:55:45 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f843a00-b8f9-49da-84b1-54b9effa6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-80146bbd-5b20-4000-a1c1-2095d90dab86 (80146bbd-5b20-4000-a1c1-2095d90dab86): created successfully Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f843a00-b8f9-49da-84b1-54b9effa6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (47727da3-3ac4-449d-8f4b-07e01aa01424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:45 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2e97928d-5087-4bd8-aef5-98ae444dc843 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Flow 'volume_create_manager' (03fe1a19-1e9e-484c-9fc7-9c5f26245d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a046d5-d41f-4b10-81f5-c9b6e48a2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a046d5-d41f-4b10-81f5-c9b6e48a2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-366225407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02c7ecd-d2ed-4963-b339-31f01328824d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a589ab894f405d8cc4329064926f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:46Z,use_quota=True,user_id='702132c40f774fef98940b6064119c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74509c07-4123-4a27-8a78-9049d94252e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74509c07-4123-4a27-8a78-9049d94252e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a898585-72d4-4afd-90c8-cb4f2657b189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a898585-72d4-4afd-90c8-cb4f2657b189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02c7ecd-d2ed-4963-b339-31f01328824d', 'volume_name': 'volume-e02c7ecd-d2ed-4963-b339-31f01328824d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32494d2-bca3-4c66-a914-0325b9a7bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32494d2-bca3-4c66-a914-0325b9a7bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f02a88-69c4-45c8-8fb4-7acd8ee09eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Volume e02c7ecd-d2ed-4963-b339-31f01328824d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02c7ecd-d2ed-4963-b339-31f01328824d', 'volume_size': 1} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:45 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a 1073741824" returned: 0 in 0.523s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:45 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a Apr 14 03:55:45 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:46 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061603891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e124972c-b04a-4729-98ae-75a9ebac752c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:44Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume e124972c-b04a-4729-98ae-75a9ebac752c {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:46 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b281269-5f6b-4ae2-8ea9-f8f41f103488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45fb516-63b6-4f43-b1cb-768be6242c6a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0116b183-a00f-400b-b6e4-9d2959ec7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:46 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c 1073741824 Apr 14 03:55:46 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-e45fb516-63b6-4f43-b1cb-768be6242c6a (e45fb516-63b6-4f43-b1cb-768be6242c6a): created successfully Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0116b183-a00f-400b-b6e4-9d2959ec7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (6c30208f-bdb4-41ce-9450-259dc1d5f31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d5dc8e3f-75b5-4135-9224-28a0b676f794 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:46 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c 1073741824" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:46 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c Apr 14 03:55:46 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:47 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.372s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174126250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:45Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:47 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d539a0-ba68-4cf5-90aa-92c700a46984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e124972c-b04a-4729-98ae-75a9ebac752c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20242791-c534-4731-95fb-871643633b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:47 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d 1073741824 Apr 14 03:55:47 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:47 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-e124972c-b04a-4729-98ae-75a9ebac752c (e124972c-b04a-4729-98ae-75a9ebac752c): created successfully Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20242791-c534-4731-95fb-871643633b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (142587b9-8332-4db8-85aa-bd525d5c4a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-eedbfd19-2a1f-4215-ac9f-a98cc1760028 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:47 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d 1073741824" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:47 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d Apr 14 03:55:47 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:48 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" returned: 0 in 0.435s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109693052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4eb205-1dca-4060-bf42-a6633f1b625f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fa40498da046c3b78666cf2e307487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:45Z,use_quota=True,user_id='a95220cf38e94aaba01da101e76a9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Creating volume cd4eb205-1dca-4060-bf42-a6633f1b625f {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:48 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a95d294-61af-41dd-8c15-59aea9950e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7007d4b-cdc9-496b-90e1-890520399d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:48 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f 1073741824 Apr 14 03:55:48 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:48 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d (ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d): created successfully Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7007d4b-cdc9-496b-90e1-890520399d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (079303ad-b20b-4ee8-9faf-8ec1bfddac8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-67255371-0d66-4d7b-a230-07e7df66e39e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:48 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f 1073741824" returned: 0 in 0.486s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:48 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f Apr 14 03:55:48 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:49 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.550s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-366225407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02c7ecd-d2ed-4963-b339-31f01328824d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a589ab894f405d8cc4329064926f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:55:46Z,use_quota=True,user_id='702132c40f774fef98940b6064119c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Creating volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:55:49 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff636089-87d4-47a9-bd46-fbc3da4bb05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4eb205-1dca-4060-bf42-a6633f1b625f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c394d5b-088c-4a48-b57d-8b7db08e98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:49 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d 1073741824 Apr 14 03:55:49 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:49 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Volume volume-cd4eb205-1dca-4060-bf42-a6633f1b625f (cd4eb205-1dca-4060-bf42-a6633f1b625f): created successfully Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c394d5b-088c-4a48-b57d-8b7db08e98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Flow 'volume_create_manager' (8b1a61b2-e1ca-4555-8300-1c71a68cb078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-91f2824b-cefd-4157-ad84-e99a16c63a81 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created volume successfully. Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-cd4eb205-1dca-4060-bf42-a6633f1b625f-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-cd4eb205-1dca-4060-bf42-a6633f1b625f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-cd4eb205-1dca-4060-bf42-a6633f1b625f" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-cd4eb205-1dca-4060-bf42-a6633f1b625f" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc96625-ac29-4336-9e33-cf1adbfad1bb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:49 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f Apr 14 03:55:49 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:49 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d 1073741824" returned: 0 in 0.559s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:49 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d Apr 14 03:55:49 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:49 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:49 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f Apr 14 03:55:49 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:50 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d" returned: 0 in 0.396s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f02a88-69c4-45c8-8fb4-7acd8ee09eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02c7ecd-d2ed-4963-b339-31f01328824d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e457bc1-a3f4-4819-b40d-9990366aa036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:55:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Volume volume-e02c7ecd-d2ed-4963-b339-31f01328824d (e02c7ecd-d2ed-4963-b339-31f01328824d): created successfully Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e457bc1-a3f4-4819-b40d-9990366aa036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Flow 'volume_create_manager' (03fe1a19-1e9e-484c-9fc7-9c5f26245d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:55:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-3ff99d8d-c475-49b5-a454-532a39654cd6 tempest-VolumesSnapshotListTestJSON-205036995 None] Created volume successfully. Apr 14 03:55:50 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cd4eb205-1dca-4060-bf42-a6633f1b625f" returned: 0 in 0.418s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-cd4eb205-1dca-4060-bf42-a6633f1b625f" released by "delete_volume" :: held 0.923s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['c87e2893-047b-4425-aacd-2ffa195692f4', '4b392d9e-d252-4f6b-92f0-6e6271627bc2', 'd2f260b0-e699-43f0-92d0-137278268b72', 'b94ad145-63a6-4de8-905a-3c79901a86b1'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:50 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:50 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a96a1e-e155-46bd-9abd-a1bd7cce141d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:50 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d Apr 14 03:55:50 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:50 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.455s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b8ee8dbb-b732-41b9-843a-1577cab85d9a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-cd4eb205-1dca-4060-bf42-a6633f1b625f-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Creating offline snapshot ee651a9d-4955-45ec-8589-648970078b57 of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb5a6af-a7a3-450e-80b5-30a20031b03f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:50 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d Apr 14 03:55:50 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:51 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" returned: 0 in 0.538s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:51 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d Apr 14 03:55:51 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:51 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:51 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 1G Apr 14 03:55:51 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:51 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d" released by "delete_volume" :: held 0.959s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['afb95a48-6f82-4059-b7a1-eecddcb4bf53', '40bf5f66-530f-4bd0-a958-c20d4bef1cd2', '627bf491-7cd7-479a-a64c-4a25dfdbf71b', '5d8151ed-2ae8-4179-b5e8-8845f989101b'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:51 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:51 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-e124972c-b04a-4729-98ae-75a9ebac752c-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-e124972c-b04a-4729-98ae-75a9ebac752c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-e124972c-b04a-4729-98ae-75a9ebac752c" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-e124972c-b04a-4729-98ae-75a9ebac752c" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10900e4-928a-4e88-aaca-e673e7a8b078]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:51 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c Apr 14 03:55:51 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:51 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:51 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:51 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c5809451-5a5c-4b51-9874-048d5fa8cf0e tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-ef5d9e45-3837-4ae6-84ee-4ee3a4988c5d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:52 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 1G" returned: 0 in 0.639s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:52 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:55:52 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:52 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c" returned: 0 in 0.528s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:52 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c Apr 14 03:55:52 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:52 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:52 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 is being set with open permissions: ugo+rw Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:52 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:55:52 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:52 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e124972c-b04a-4729-98ae-75a9ebac752c" returned: 0 in 0.406s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-e124972c-b04a-4729-98ae-75a9ebac752c" released by "delete_volume" :: held 0.990s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['9f9fba96-26e1-4da4-ac97-ebb1420193aa', '66dff618-6cdc-440f-9024-95aba89e4eb8', 'f225b5b0-9915-4dd6-a0b7-703960e72ed8', 'aea8734f-4e5a-4741-be3a-17f3d51a25d4'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:52 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:52 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:52 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:52 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info Apr 14 03:55:52 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:53 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:53 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64d54886-c91a-45f8-9bb0-d57421f7f6e7 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-e124972c-b04a-4729-98ae-75a9ebac752c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:53 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info" returned: 0 in 0.424s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:53 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info is being set with open permissions: ugo+rw Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:53 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info Apr 14 03:55:53 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-e45fb516-63b6-4f43-b1cb-768be6242c6a-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-e45fb516-63b6-4f43-b1cb-768be6242c6a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-e45fb516-63b6-4f43-b1cb-768be6242c6a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-e45fb516-63b6-4f43-b1cb-768be6242c6a" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a50cd2-f658-48fb-bd2d-cf8b8f60f02d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:53 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.info" returned: 0 in 0.442s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:53 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d97a52f3-1cc4-428c-9f54-fe622f823a77 tempest-VolumesSnapshotListTestJSON-205036995 None] Create snapshot completed successfully Apr 14 03:55:53 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a Apr 14 03:55:53 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Creating offline snapshot 73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c314e5-6798-49f7-8102-63851df1364f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:54 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:55:54 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:54 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:54 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a Apr 14 03:55:54 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:54 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.477s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:54 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c 1G Apr 14 03:55:54 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:54 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e45fb516-63b6-4f43-b1cb-768be6242c6a" returned: 0 in 0.406s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-e45fb516-63b6-4f43-b1cb-768be6242c6a" released by "delete_volume" :: held 0.915s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['6573b03c-1365-4974-bb63-a578c61aa43e', '80673b6e-ea3a-4866-b071-daac42ebf6fa', '8ed953a2-2238-45f7-92dd-cad7221f2ee2', 'ab686b67-2f88-437f-a343-f0a054ec70a0'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:54 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:54 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-80146bbd-5b20-4000-a1c1-2095d90dab86-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-80146bbd-5b20-4000-a1c1-2095d90dab86-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-80146bbd-5b20-4000-a1c1-2095d90dab86" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-80146bbd-5b20-4000-a1c1-2095d90dab86" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc3d5b0-60f4-47b8-a0ef-c4318461ad6f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:54 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 Apr 14 03:55:54 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:55 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c 1G" returned: 0 in 0.507s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:55 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:55:55 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:55 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.449s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:55 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9a03bf6f-7ab2-4d5d-ab65-6f27966947fc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-e45fb516-63b6-4f43-b1cb-768be6242c6a-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:55 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:55 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86 Apr 14 03:55:55 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:55 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:55 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c is being set with open permissions: ugo+rw Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:55 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:55:55 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:55 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-80146bbd-5b20-4000-a1c1-2095d90dab86" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-80146bbd-5b20-4000-a1c1-2095d90dab86" released by "delete_volume" :: held 0.943s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['5ae77512-2b11-411a-a45f-f013042d7d87', 'af6b4b3b-eaad-45e0-b62c-3f82363135d1', '0602e617-ac1f-4127-bfa6-8a5c4f27ef71', '790e250b-3f59-424d-9294-383cd8f4ab91'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:55 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:55 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-2d1db3bf-5701-4292-9b6e-e317704010f4-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-2d1db3bf-5701-4292-9b6e-e317704010f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:55 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-2d1db3bf-5701-4292-9b6e-e317704010f4" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-2d1db3bf-5701-4292-9b6e-e317704010f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleting offline snapshot 2d1db3bf-5701-4292-9b6e-e317704010f4 of volume 84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] snapshot_file for this snap is: volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7905fc7-d64b-47c6-b9ae-dcfbb1583c86]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:56 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1a044ee6-9730-42cf-97ed-117f7e171bf2 tempest-VolumesSnapshotListTestJSON-205036995 None] Create snapshot completed successfully Apr 14 03:55:56 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 Apr 14 03:55:56 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Creating offline snapshot 4a122f0d-c720-4133-b619-025f59cfb1df of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97446d-fa0c-4378-8243-4535bacbc0ac]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:56 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:56 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:56 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:55:56 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a49eccab-2525-431e-90cc-b35911739fbc tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-80146bbd-5b20-4000-a1c1-2095d90dab86-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:56 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2536b3-f997-456c-ad26-4efd4200ffa1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:56 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 Apr 14 03:55:56 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:56 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:55:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:56 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df 1G Apr 14 03:55:56 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:57 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" returned: 0 in 0.481s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:57 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 Apr 14 03:55:57 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:57 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df 1G" returned: 0 in 0.491s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:57 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df Apr 14 03:55:57 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:57 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:57 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4 Apr 14 03:55:57 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:57 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df" returned: 0 in 0.437s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:57 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df is being set with open permissions: ugo+rw Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:57 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df Apr 14 03:55:57 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:57 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21.2d1db3bf-5701-4292-9b6e-e317704010f4" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-2d1db3bf-5701-4292-9b6e-e317704010f4" released by "_delete_snapshot" :: held 1.927s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" released by "delete_snapshot" :: held 1.947s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:57 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['5b1cd6c9-3c9a-47a4-8164-53f0c3070185', '4f195fe4-51eb-4f5c-804c-917661fe5e77', 'fec898c1-6871-409b-9af3-4ba4654dd7aa', '33622694-fed4-49bb-863f-65e03b0fa154'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Delete snapshot completed successfully. Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf7ab533-aec0-4a0d-9c0f-0d52b3ea3985 tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-2d1db3bf-5701-4292-9b6e-e317704010f4-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-84bc49f3-4336-4a3d-a3c8-89de5f0fae21-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-84bc49f3-4336-4a3d-a3c8-89de5f0fae21-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd8e95-189d-410c-9db0-6c19bfed1397]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:58 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:58 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 Apr 14 03:55:58 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6a261735-7f0e-4cc6-af9a-28d092d78555 tempest-VolumesSnapshotListTestJSON-205036995 None] Create snapshot completed successfully Apr 14 03:55:58 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" returned: 0 in 0.524s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:58 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21 Apr 14 03:55:58 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:58 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:58 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:59 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" returned: 0 in 0.427s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-quobyte-84bc49f3-4336-4a3d-a3c8-89de5f0fae21" released by "delete_volume" :: held 0.992s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Created reservations ['95e6381d-70ec-470c-9cf3-0614c2cb9e33', '99464553-515b-48f2-b931-b4e6578f4f78', '75297ca0-3797-4478-a66e-b0896ed770ea', '60c95a05-e211-4fc9-8ae1-add522905890'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-4a122f0d-c720-4133-b619-025f59cfb1df-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-4a122f0d-c720-4133-b619-025f59cfb1df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-4a122f0d-c720-4133-b619-025f59cfb1df" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-4a122f0d-c720-4133-b619-025f59cfb1df" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Deleting offline snapshot 4a122f0d-c720-4133-b619-025f59cfb1df of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:55:59 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:55:59 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] snapshot_file for this snap is: volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b154a23-d1fa-4cc0-a9ea-ce3f9cc573af]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:59 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df Apr 14 03:55:59 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:55:59 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.493s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:59 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:55:59 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Deleted volume successfully. Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9aeb0237-eb43-45de-95d1-ff2c1e975f7a tempest-CreateVolumesFromSnapshotTest-1915721202 None] Lock "cinder-84bc49f3-4336-4a3d-a3c8-89de5f0fae21-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:55:59 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df" returned: 0 in 0.520s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d41799-c409-4ba7-9258-49c2bbf0f964]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:55:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:55:59 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:55:59 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:00 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:00 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df Apr 14 03:56:00 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:00 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (80c66ca7-b276-4e69-b01d-98e19d1627bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a0bac7-1a55-40dc-ae85-db5de96b17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df" returned: 0 in 0.571s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:00 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df Apr 14 03:56:00 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a0bac7-1a55-40dc-ae85-db5de96b17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-486132569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:01Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61285fff-5235-47c7-810f-f2079d6f79a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61285fff-5235-47c7-810f-f2079d6f79a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c97adb-42d9-4f97-8de2-6600e0a15ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c97adb-42d9-4f97-8de2-6600e0a15ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2', 'volume_name': 'volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99efb6fa-e10f-4d75-a99e-8aa8e63660e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99efb6fa-e10f-4d75-a99e-8aa8e63660e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d164e4-c049-490b-aa78-a7892fc63010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Volume de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2', 'volume_size': 1} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-486132569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:01Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Creating volume de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:00 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:00 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 1073741824 Apr 14 03:56:00 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:01 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.4a122f0d-c720-4133-b619-025f59cfb1df" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-4a122f0d-c720-4133-b619-025f59cfb1df" released by "_delete_snapshot" :: held 2.113s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" released by "delete_snapshot" :: held 2.140s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Created reservations ['1c6a4389-6424-4217-9a79-d889f7ba8a8d', 'beaaf2be-2974-4e63-90f1-f5afad815fd1', '65ccffe9-270a-474a-9f9e-1269fc4893c2', '9970da35-89c7-4e2b-8853-8a009067fdfa'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Delete snapshot completed successfully. Apr 14 03:56:01 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-cf6ea333-2543-4da0-8460-499645458e10 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-4a122f0d-c720-4133-b619-025f59cfb1df-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 1073741824" returned: 0 in 0.466s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:01 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:01 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:01 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.403s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d164e4-c049-490b-aa78-a7892fc63010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b4d1d-e606-4763-be4b-0a4c7f1ac3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Volume volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 (de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2): created successfully Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b4d1d-e606-4763-be4b-0a4c7f1ac3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (80c66ca7-b276-4e69-b01d-98e19d1627bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:01 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-fd0bade8-c39b-4c1d-a8c6-1257daa1be99 tempest-VolumeDependencyTests-268997772 None] Created volume successfully. Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Creating offline snapshot 80345aa6-d322-45f8-8b54-62aa8fccea10 of volume de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa4af8-c393-444e-8b50-34ab6bae4021]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:02 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:02 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Deleting offline snapshot 73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] snapshot_file for this snap is: volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73abdeb-828f-4193-b315-9d7c78ee58cc]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:02 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:56:02 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:02 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:02 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 1G Apr 14 03:56:02 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:02 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f81af3-4340-4dbf-a115-2b094c3b148b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:02 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:56:02 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:03 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 1G" returned: 0 in 0.473s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:03 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:03 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:03 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.497s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:03 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:56:03 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:03 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.435s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:03 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 is being set with open permissions: ugo+rw Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:03 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:03 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:03 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.455s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:03 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c Apr 14 03:56:03 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:03 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.415s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:03 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info Apr 14 03:56:03 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:04 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c" released by "_delete_snapshot" :: held 1.898s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" released by "delete_snapshot" :: held 1.909s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Created reservations ['3e1fdd26-2fd2-4ced-b6f5-38cdac2e588e', '7e812db8-0bee-425c-bb8a-1f655bfc368b', '97783f02-793c-499b-8e1e-6fd3d27d22f9', 'f2983340-6641-4335-8549-ce969c6478fd'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Delete snapshot completed successfully. Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccfecbdc-2da1-466e-8c66-df42a72d6453 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-73ceb7f9-85ba-4b7e-aa17-81d5ffd7fa0c-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:04 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:04 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info is being set with open permissions: ugo+rw Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:04 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info Apr 14 03:56:04 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-ee651a9d-4955-45ec-8589-648970078b57-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-ee651a9d-4955-45ec-8589-648970078b57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-ee651a9d-4955-45ec-8589-648970078b57" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-ee651a9d-4955-45ec-8589-648970078b57" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Deleting offline snapshot ee651a9d-4955-45ec-8589-648970078b57 of volume e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] snapshot_file for this snap is: volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e5036-b59c-4c0d-ad2b-ff91eef90090]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:04 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:56:04 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:04 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.info" returned: 0 in 0.433s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-240e0e81-e12c-45bb-b8f5-6a1ab0fb503b tempest-VolumeDependencyTests-268997772 None] Create snapshot completed successfully Apr 14 03:56:04 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02c7ecd-d2ed-4963-b339-31f01328824d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f51de4a-909d-4050-aef7-aac55ac4be8e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:05 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d Apr 14 03:56:05 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (1853a93e-d804-4956-bbf6-003bae1d93bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6157f5-76ee-471f-9995-3a5adfc3644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6157f5-76ee-471f-9995-3a5adfc3644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-964767654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1ea945-7fa8-4bbb-a168-731058330a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80345aa6-d322-45f8-8b54-62aa8fccea10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:05Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868efb1e-1302-43c4-8df8-c0e63f50af64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868efb1e-1302-43c4-8df8-c0e63f50af64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8503281-e77f-4ce6-8c5f-85c386af63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8503281-e77f-4ce6-8c5f-85c386af63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf1ea945-7fa8-4bbb-a168-731058330a80', 'volume_name': 'volume-cf1ea945-7fa8-4bbb-a168-731058330a80', 'volume_size': 1, 'snapshot_id': '80345aa6-d322-45f8-8b54-62aa8fccea10'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5905fd-5dc9-42b7-903a-a6055a1d0733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5905fd-5dc9-42b7-903a-a6055a1d0733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:05 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6af896-4162-4f1f-866b-dcd43530617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:05 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Volume cf1ea945-7fa8-4bbb-a168-731058330a80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf1ea945-7fa8-4bbb-a168-731058330a80', 'volume_size': 1, 'snapshot_id': '80345aa6-d322-45f8-8b54-62aa8fccea10'} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d" returned: 0 in 0.521s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10-cf1ea945-7fa8-4bbb-a168-731058330a80" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10-cf1ea945-7fa8-4bbb-a168-731058330a80" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Creating volume cf1ea945-7fa8-4bbb-a168-731058330a80 from snapshot 80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:05 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:56:05 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] snapshot: 80345aa6-d322-45f8-8b54-62aa8fccea10, volume: cf1ea945-7fa8-4bbb-a168-731058330a80, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9b23fa-8ca7-4b3d-ba74-3962cf761a78]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:05 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:05 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:05 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:05 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57 Apr 14 03:56:05 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:06 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.474s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[497fdb3c-9a46-4d69-996a-69fd75e76dfa]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:06 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:06 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:06 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d.ee651a9d-4955-45ec-8589-648970078b57" returned: 0 in 0.411s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-ee651a9d-4955-45ec-8589-648970078b57" released by "_delete_snapshot" :: held 1.928s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" released by "delete_snapshot" :: held 1.943s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Created reservations ['c8cb3d5b-bc05-4d58-b971-3101f3008919', 'ad1a73d9-409e-4af7-aed6-4e7385b2ba9c', 'e0d7c18a-c95c-489a-afbd-1df8eba34a12', 'c185d1d9-da76-4eca-baa7-a360cf3e1b81'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Delete snapshot completed successfully. Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1de165a8-92ad-415d-afb8-c00c859d69e5 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-ee651a9d-4955-45ec-8589-648970078b57-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:06 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:06 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 Apr 14 03:56:06 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-e02c7ecd-d2ed-4963-b339-31f01328824d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-e02c7ecd-d2ed-4963-b339-31f01328824d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e05874-bbf5-477d-9688-b43e32c23076]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:06 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d Apr 14 03:56:06 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:07 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d" returned: 0 in 0.705s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:07 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d Apr 14 03:56:07 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:08 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e02c7ecd-d2ed-4963-b339-31f01328824d" returned: 0 in 0.883s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-quobyte-e02c7ecd-d2ed-4963-b339-31f01328824d" released by "delete_volume" :: held 1.626s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Created reservations ['3a48d79a-5225-49e7-8688-3a1c9984e78b', '66689c19-5d38-473f-8436-8e66bbda8c77', '2dd8cd25-b1bc-401b-b520-be4120740e5f', '2d89187a-ebb3-4ad4-9aab-b254f6b9f7a1'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:08 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:08 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:08 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80" returned: 0 in 2.033s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d14e83-86aa-4afa-b796-249332605a2d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:08 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:08 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:08 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Deleted volume successfully. Apr 14 03:56:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c14662a8-9d1e-48f9-95dd-bbac00c3ab80 tempest-VolumesSnapshotListTestJSON-205036995 None] Lock "cinder-e02c7ecd-d2ed-4963-b339-31f01328824d-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:09 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.601s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:56:09 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Converted 1024.00 MB image at 503.28 MB/s Apr 14 03:56:09 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 is being set with open permissions: ugo+rw Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:09 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 Apr 14 03:56:09 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:09 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80" returned: 0 in 0.451s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" released by "_copy_volume_from_snapshot" :: held 4.118s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10-cf1ea945-7fa8-4bbb-a168-731058330a80" released by "_create_volume_from_snapshot" :: held 4.137s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.157s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6af896-4162-4f1f-866b-dcd43530617b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1ea945-7fa8-4bbb-a168-731058330a80', 'volume_size': 1, 'snapshot_id': '80345aa6-d322-45f8-8b54-62aa8fccea10'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ce950e-5d59-420f-ae66-7335c3cfe4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:09 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Volume volume-cf1ea945-7fa8-4bbb-a168-731058330a80 (cf1ea945-7fa8-4bbb-a168-731058330a80): created successfully Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ce950e-5d59-420f-ae66-7335c3cfe4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (1853a93e-d804-4956-bbf6-003bae1d93bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-93c2a190-2b72-435b-8bb7-3c2207506a9d tempest-VolumeDependencyTests-268997772 None] Created volume successfully. Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (5e22bba7-2d57-458b-b0bd-0b2790ff3a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf898a13-a357-48ca-aa5a-5551ebb41f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf898a13-a357-48ca-aa5a-5551ebb41f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272960185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7338854a-d3c8-48c8-9257-0ff8edd5e2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:10Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5430e3-19d4-4d04-b636-b3827234c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5430e3-19d4-4d04-b636-b3827234c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246dbe4c-d214-412d-bfa2-6d2e44769eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246dbe4c-d214-412d-bfa2-6d2e44769eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7338854a-d3c8-48c8-9257-0ff8edd5e2bd', 'volume_name': 'volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37070d69-62d5-40ea-b9ce-a124c874e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37070d69-62d5-40ea-b9ce-a124c874e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc26fa9-9846-4725-9343-620f21e17291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Volume 7338854a-d3c8-48c8-9257-0ff8edd5e2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd', 'volume_size': 1} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272960185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7338854a-d3c8-48c8-9257-0ff8edd5e2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:10Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Creating volume 7338854a-d3c8-48c8-9257-0ff8edd5e2bd {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:10 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:10 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd 1073741824 Apr 14 03:56:10 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-80345aa6-d322-45f8-8b54-62aa8fccea10-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (cc69f041-3232-4888-b70c-005163df5bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cea969-6365-45fe-83ca-6106014f8a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-80345aa6-d322-45f8-8b54-62aa8fccea10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cea969-6365-45fe-83ca-6106014f8a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884803827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6ab613-5527-41ce-a959-1555ffeff5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba5edbf-26eb-4378-9042-c3597fd92bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba5edbf-26eb-4378-9042-c3597fd92bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b14184-9cc3-4713-a639-e0194a3908be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b14184-9cc3-4713-a639-e0194a3908be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6ab613-5527-41ce-a959-1555ffeff5ba', 'volume_name': 'volume-ef6ab613-5527-41ce-a959-1555ffeff5ba', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308b56d5-c1e3-4967-b017-eb89dded0863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308b56d5-c1e3-4967-b017-eb89dded0863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9b6c9-877d-4151-97a4-a593c897eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Volume ef6ab613-5527-41ce-a959-1555ffeff5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6ab613-5527-41ce-a959-1555ffeff5ba', 'volume_size': 1} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Deleting offline snapshot 80345aa6-d322-45f8-8b54-62aa8fccea10 of volume de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] snapshot_file for this snap is: volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b0c00-ba22-4873-b87a-5f922696be76]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (a56cbfdc-4975-44f3-9af4-725576a5282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c43b584-0f41-4f14-ba5e-486a631ec5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c43b584-0f41-4f14-ba5e-486a631ec5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-127358507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8518ef86-00cf-4fb3-8ef0-ef96d37e0a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28c52cc-a886-42f3-8d4f-468ffd05744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28c52cc-a886-42f3-8d4f-468ffd05744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98db1981-a740-456b-9bfe-78d62ad66d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98db1981-a740-456b-9bfe-78d62ad66d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8518ef86-00cf-4fb3-8ef0-ef96d37e0a86', 'volume_name': 'volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:10 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a88fda-e616-451b-84be-5c921c29b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a88fda-e616-451b-84be-5c921c29b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cd0d2d-a1e0-4a75-be2d-8152f4ab8f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Volume 8518ef86-00cf-4fb3-8ef0-ef96d37e0a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86', 'volume_size': 1} Apr 14 03:56:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:11 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (1a58a217-0fb7-4f72-8dd5-ab50551114b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a22b9a-8bc6-4c9e-bb1b-4ab5f6265227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a22b9a-8bc6-4c9e-bb1b-4ab5f6265227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974706933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0329ae63-a009-4482-ab3e-23a5874e0138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572b010d-bb7f-4555-a6f5-f651b49ed953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572b010d-bb7f-4555-a6f5-f651b49ed953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2aed21-993b-4723-a92b-18595ae2d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2aed21-993b-4723-a92b-18595ae2d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0329ae63-a009-4482-ab3e-23a5874e0138', 'volume_name': 'volume-0329ae63-a009-4482-ab3e-23a5874e0138', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1e7846-4377-4a66-a195-9f8f91c46cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1e7846-4377-4a66-a195-9f8f91c46cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4da13e-ca76-40dc-8a61-f37c4d72a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Volume 0329ae63-a009-4482-ab3e-23a5874e0138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0329ae63-a009-4482-ab3e-23a5874e0138', 'volume_size': 1} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd 1073741824" returned: 0 in 0.605s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:11 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd Apr 14 03:56:11 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (4a30febb-9457-44f7-bbd6-b8670dacda22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e2304a-444e-4c04-936f-8ece8b24017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e2304a-444e-4c04-936f-8ece8b24017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868816260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2aedab-c27c-4c5c-971d-816dc2387371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bddf6b7-550b-4e96-9bc4-242e73f54dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bddf6b7-550b-4e96-9bc4-242e73f54dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f3ac35-d941-4068-86d7-a8a571e0d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f3ac35-d941-4068-86d7-a8a571e0d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2aedab-c27c-4c5c-971d-816dc2387371', 'volume_name': 'volume-5e2aedab-c27c-4c5c-971d-816dc2387371', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26039058-9fb9-4701-85ec-457d239ffa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26039058-9fb9-4701-85ec-457d239ffa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894a9c0-501a-4142-9923-26a0c5d69e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Volume 5e2aedab-c27c-4c5c-971d-816dc2387371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2aedab-c27c-4c5c-971d-816dc2387371', 'volume_size': 1} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:11 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.587s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0cb9a-12a5-4092-9ee5-1f61ed2390a9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:11 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:11 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:11 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" returned: 0 in 0.445s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1884803827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6ab613-5527-41ce-a959-1555ffeff5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Creating volume ef6ab613-5527-41ce-a959-1555ffeff5ba {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:11 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc26fa9-9846-4725-9343-620f21e17291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba 1073741824 Apr 14 03:56:11 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dc6d93-76b1-4636-b346-ece2bf1d4043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:11 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Volume volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd (7338854a-d3c8-48c8-9257-0ff8edd5e2bd): created successfully Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dc6d93-76b1-4636-b346-ece2bf1d4043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (5e22bba7-2d57-458b-b0bd-0b2790ff3a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:11 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a22d7e48-4e0a-47dc-89e2-889d9619bf32 tempest-CreateVolumesFromImageTest-1263558805 None] Created volume successfully. Apr 14 03:56:11 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.473s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:11 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:11 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:12 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba 1073741824" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:12 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba Apr 14 03:56:12 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:12 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:12 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10 Apr 14 03:56:12 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:12 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-127358507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8518ef86-00cf-4fb3-8ef0-ef96d37e0a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Creating volume 8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:12 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:12 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 1073741824 Apr 14 03:56:12 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9b6c9-877d-4151-97a4-a593c897eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6ab613-5527-41ce-a959-1555ffeff5ba', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd273761-52c9-40ec-ada7-30cd26bbb68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:12 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Volume volume-ef6ab613-5527-41ce-a959-1555ffeff5ba (ef6ab613-5527-41ce-a959-1555ffeff5ba): created successfully Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd273761-52c9-40ec-ada7-30cd26bbb68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (cc69f041-3232-4888-b70c-005163df5bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-af67e5ec-8243-4b8f-a199-d1d653cac12d tempest-CreateVolumesFromImageTest-1263558805 None] Created volume successfully. Apr 14 03:56:12 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2.80345aa6-d322-45f8-8b54-62aa8fccea10" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-80345aa6-d322-45f8-8b54-62aa8fccea10" released by "_delete_snapshot" :: held 2.004s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" released by "delete_snapshot" :: held 2.018s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Created reservations ['ae46fc92-01e6-4a83-a0c2-ad10353cb7c4', '53681ffb-f837-45b1-ae6d-273d0628a235', 'f2c1afcd-8bf3-4e68-9f99-e2c01f8cd53e', '34dd45ee-ae10-401f-b8b1-fc251ba6ba6d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Delete snapshot completed successfully. Apr 14 03:56:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7d70a62c-c778-4b10-890a-a45fbb541c06 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-80345aa6-d322-45f8-8b54-62aa8fccea10-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:13 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 1073741824" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:13 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 Apr 14 03:56:13 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:13 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.367s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974706933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0329ae63-a009-4482-ab3e-23a5874e0138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Creating volume 0329ae63-a009-4482-ab3e-23a5874e0138 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:13 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cd0d2d-a1e0-4a75-be2d-8152f4ab8f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68073aa6-794b-46a3-8be8-a35f0ca7ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:13 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 1073741824 Apr 14 03:56:13 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:13 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Volume volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 (8518ef86-00cf-4fb3-8ef0-ef96d37e0a86): created successfully Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68073aa6-794b-46a3-8be8-a35f0ca7ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (a56cbfdc-4975-44f3-9af4-725576a5282a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d5fcc374-786e-4f82-9386-3dd86f1c086c tempest-CreateVolumesFromImageTest-1263558805 None] Created volume successfully. Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba921258-235c-40dc-8894-e65fd5f524ae]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:14 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:14 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:14 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 1073741824" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:14 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 Apr 14 03:56:14 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:14 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.465s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:14 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2 Apr 14 03:56:14 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:14 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138" returned: 0 in 0.418s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.071s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868816260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2aedab-c27c-4c5c-971d-816dc2387371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d858e57c84ac4eeebf2177a3cdb0e5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:11Z,use_quota=True,user_id='10de21d242164bd69717d294ea5b8e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Creating volume 5e2aedab-c27c-4c5c-971d-816dc2387371 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:14 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4da13e-ca76-40dc-8a61-f37c4d72a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0329ae63-a009-4482-ab3e-23a5874e0138', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:14 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 1073741824 Apr 14 03:56:14 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57baedf-5467-4a96-8e4e-c9b46a8e1e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:14 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Volume volume-0329ae63-a009-4482-ab3e-23a5874e0138 (0329ae63-a009-4482-ab3e-23a5874e0138): created successfully Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57baedf-5467-4a96-8e4e-c9b46a8e1e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (1a58a217-0fb7-4f72-8dd5-ab50551114b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c439b030-bb8f-4c2f-8955-b61e3662fa75 tempest-CreateVolumesFromImageTest-1263558805 None] Created volume successfully. Apr 14 03:56:14 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" returned: 0 in 0.423s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2" released by "delete_volume" :: held 0.923s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Created reservations ['7a4b0db4-cc97-4059-b0bf-e8c4ede50da3', '66036a3a-45c0-4331-83cf-2182035c34ba', '162d8f33-450a-44a6-9f4e-b1f8c93ccb63', 'e194755c-eb0e-409d-8fd0-03afce9d4c79'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:14 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:14 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:15 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 1073741824" returned: 0 in 0.516s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:15 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 Apr 14 03:56:15 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (540bd016-faad-470a-8363-793e01f98725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6924da2-e157-4c57-b29c-9dfbf5762025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6924da2-e157-4c57-b29c-9dfbf5762025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-226301059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66814d7a-c9b5-494e-99b9-b54d8863e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:15Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4cd359-adbd-4f0c-a5db-87717a97bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4cd359-adbd-4f0c-a5db-87717a97bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3d92f5-996f-433d-b8e8-253a2ea264a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3d92f5-996f-433d-b8e8-253a2ea264a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'volume_name': 'volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379e0a91-94da-4bb0-a393-a737f2b3037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379e0a91-94da-4bb0-a393-a737f2b3037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e268bb46-9a27-483b-9935-29fb976c297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Volume 66814d7a-c9b5-494e-99b9-b54d8863e7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'volume_size': 1} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:15 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Deleted volume successfully. Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-30810b78-8225-4e3f-8399-560231c777cc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-de16b4e7-ccd4-4b25-a0cb-b08b1f7d8af2-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:15 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-226301059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66814d7a-c9b5-494e-99b9-b54d8863e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:15Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Creating volume 66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:15 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894a9c0-501a-4142-9923-26a0c5d69e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2aedab-c27c-4c5c-971d-816dc2387371', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 1073741824 Apr 14 03:56:15 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68505ff-6cc7-457b-9a4a-444bde34e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Volume volume-5e2aedab-c27c-4c5c-971d-816dc2387371 (5e2aedab-c27c-4c5c-971d-816dc2387371): created successfully Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68505ff-6cc7-457b-9a4a-444bde34e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Flow 'volume_create_manager' (4a30febb-9457-44f7-bbd6-b8670dacda22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c2228551-b83c-4de4-b1de-d4c58edef897 tempest-CreateVolumesFromImageTest-1263558805 None] Created volume successfully. Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-5e2aedab-c27c-4c5c-971d-816dc2387371-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-5e2aedab-c27c-4c5c-971d-816dc2387371-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-quobyte-5e2aedab-c27c-4c5c-971d-816dc2387371" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-5e2aedab-c27c-4c5c-971d-816dc2387371" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa6c10a-2339-406d-ac4b-8375b7a5f53f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:15 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 Apr 14 03:56:15 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:15 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 1073741824" returned: 0 in 0.520s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:16 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:16 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:16 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371" returned: 0 in 0.493s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:16 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371 Apr 14 03:56:16 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:16 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.405s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e268bb46-9a27-483b-9935-29fb976c297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c85d813-b05b-4619-9781-ee1cdb6b53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Volume volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 (66814d7a-c9b5-494e-99b9-b54d8863e7d7): created successfully Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c85d813-b05b-4619-9781-ee1cdb6b53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (540bd016-faad-470a-8363-793e01f98725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-604a165d-9fd7-428b-801f-0ff44df56edd tempest-VolumeDependencyTests-268997772 None] Created volume successfully. Apr 14 03:56:16 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5e2aedab-c27c-4c5c-971d-816dc2387371" returned: 0 in 0.422s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-5e2aedab-c27c-4c5c-971d-816dc2387371" released by "delete_volume" :: held 0.944s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Created reservations ['c79c6a04-3900-440c-afb1-919c4b6a91f4', '46e965d5-c820-4eb6-b52a-f235469cff23', '2701b7a8-0751-498c-b064-a780332d06ce', 'd5b9ac8f-3d51-46f7-aa7c-b7028207ff23'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:16 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:16 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-0329ae63-a009-4482-ab3e-23a5874e0138-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-0329ae63-a009-4482-ab3e-23a5874e0138-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-quobyte-0329ae63-a009-4482-ab3e-23a5874e0138" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-0329ae63-a009-4482-ab3e-23a5874e0138" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be4867-af2f-44c2-9434-effe3a8e347e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:16 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 Apr 14 03:56:16 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:17 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.430s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:17 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Deleted volume successfully. Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ade8ee39-e0e1-4185-9b50-034d6c43fba8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-5e2aedab-c27c-4c5c-971d-816dc2387371-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:17 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:17 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138 Apr 14 03:56:17 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (d9dbd21a-8a1e-427f-9713-1dffa76a9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eb2d06-99be-4171-b974-9f5bbe652f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eb2d06-99be-4171-b974-9f5bbe652f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1510931454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fac25e-fc1d-444f-aa09-edac4565f4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a471f0b96a4d419ed366f5ccfc9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=66814d7a-c9b5-494e-99b9-b54d8863e7d7,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:18Z,use_quota=True,user_id='0f4545aface84162a62cd5a18b2bbe9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de528c-b7f5-4cbb-9ff2-7fa3f0a508dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de528c-b7f5-4cbb-9ff2-7fa3f0a508dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2debad-4f53-4388-8db0-f5bd0c6d39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2debad-4f53-4388-8db0-f5bd0c6d39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '64fac25e-fc1d-444f-aa09-edac4565f4d6', 'volume_name': 'volume-64fac25e-fc1d-444f-aa09-edac4565f4d6', 'volume_size': 1, 'source_volid': '66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049b3e21-9874-4fda-9d13-c76893042991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049b3e21-9874-4fda-9d13-c76893042991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5c9c08-7665-42f3-939f-78e75ba97c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:17 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Volume 64fac25e-fc1d-444f-aa09-edac4565f4d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-64fac25e-fc1d-444f-aa09-edac4565f4d6', 'volume_size': 1, 'source_volid': '66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'source_volstatus': 'available'} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:17 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Cloning volume 66814d7a-c9b5-494e-99b9-b54d8863e7d7 to volume 64fac25e-fc1d-444f-aa09-edac4565f4d6 Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Creating offline snapshot 8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 of volume 66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d44646-021c-4ea8-be5f-9575889997e1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:17 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:17 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:17 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0329ae63-a009-4482-ab3e-23a5874e0138" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-0329ae63-a009-4482-ab3e-23a5874e0138" released by "delete_volume" :: held 0.943s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Created reservations ['27525981-fe88-4bd1-8e77-71d1968a268a', '58720b04-6375-4f2a-b7d9-40819c076837', '78ae9298-c1e0-4df0-822e-ba18b4537422', '62f4b255-16f1-490b-a7a7-2a94de1eb990'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:17 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:17 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:17 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-quobyte-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[679e52e9-cff9-4b74-bd7e-7bea2e325a30]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:18 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 Apr 14 03:56:18 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:18 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:18 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 1G Apr 14 03:56:18 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:18 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.427s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:18 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Deleted volume successfully. Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d42acc96-937f-464c-9591-fe25f100f426 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-0329ae63-a009-4482-ab3e-23a5874e0138-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:18 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:18 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86 Apr 14 03:56:18 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:18 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 1G" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:18 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:18 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:18 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86" released by "delete_volume" :: held 0.972s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Created reservations ['30f6670c-bfb0-4add-992c-3f25efdfbcc5', 'f0b51cec-0dc1-49d7-bde3-fcd7f2aeee07', '8deb30f1-ef55-4390-8ffc-0f76ffd32b51', '5789ba9c-3c3f-4af3-b7dd-bb7ad515bbb9'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:19 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:19 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-ef6ab613-5527-41ce-a959-1555ffeff5ba-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-ef6ab613-5527-41ce-a959-1555ffeff5ba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:19 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.446s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:19 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 is being set with open permissions: ugo+rw Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:19 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:19 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-quobyte-ef6ab613-5527-41ce-a959-1555ffeff5ba" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-ef6ab613-5527-41ce-a959-1555ffeff5ba" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59ba87-08ee-4779-9826-e2069bcd8b98]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:19 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba Apr 14 03:56:19 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:19 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.432s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Deleted volume successfully. Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-17f497cf-376e-47bc-bbac-55d7affa981e tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-8518ef86-00cf-4fb3-8ef0-ef96d37e0a86-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:19 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.429s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:19 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info Apr 14 03:56:19 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:19 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:19 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba Apr 14 03:56:19 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info is being set with open permissions: ugo+rw Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:20 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info Apr 14 03:56:20 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ef6ab613-5527-41ce-a959-1555ffeff5ba" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-ef6ab613-5527-41ce-a959-1555ffeff5ba" released by "delete_volume" :: held 0.918s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Created reservations ['e48cbca5-cc7c-4c99-890d-8d159ba63676', 'be59cbeb-0894-4e96-8a33-806e5e743048', '736b9f39-d7ea-4c00-bfb4-0b9ae4b355cd', 'f9c265e0-e80c-4ad8-adad-bd4515b2a244'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:20 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:20 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-7338854a-d3c8-48c8-9257-0ff8edd5e2bd-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-7338854a-d3c8-48c8-9257-0ff8edd5e2bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "cinder-quobyte-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4314003a-8b82-4d71-a9d7-46d08b718748]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:20 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd Apr 14 03:56:20 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.info" returned: 0 in 0.449s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] snapshot: 8fc5a3d7-f434-472e-aeaf-d3fa18f17b78, volume: 64fac25e-fc1d-444f-aa09-edac4565f4d6, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6270754-5157-4ff7-9c06-3b46787b75b4]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:20 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:20 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.426s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Deleted volume successfully. Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1eb817eb-cc7b-4dd2-a0ff-3d47b93580c8 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-ef6ab613-5527-41ce-a959-1555ffeff5ba-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:20 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" returned: 0 in 0.504s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:20 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd Apr 14 03:56:20 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:20 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dd62e9-976b-4dfd-9d75-2ef9a00bce2e]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:21 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:21 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:21 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" returned: 0 in 0.401s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-quobyte-7338854a-d3c8-48c8-9257-0ff8edd5e2bd" released by "delete_volume" :: held 0.925s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Created reservations ['10fb66fd-a964-4d2f-86bc-e35f6e9ea9e3', 'cb8a9d0a-9218-4b8c-8632-db74036ab677', '45d34991-8e00-4ce0-927e-65ff3a7190bf', 'fbe7067c-6c77-4169-8d26-3a8d06041675'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:21 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:21 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:21 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.496s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:21 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 Apr 14 03:56:21 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:21 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:21 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Deleted volume successfully. Apr 14 03:56:21 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6fe3c453-8c6c-4027-85a6-d5cd3484f915 tempest-CreateVolumesFromImageTest-1263558805 None] Lock "cinder-7338854a-d3c8-48c8-9257-0ff8edd5e2bd-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:23 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6" returned: 0 in 2.120s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:23 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe8eb5-feeb-4f49-a107-776c7b69f363]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:23 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:23 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Flow 'volume_create_manager' (6663a31b-7980-465c-95a9-d87178db0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57938d4d-3d00-4dce-a9fe-9f1434946a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57938d4d-3d00-4dce-a9fe-9f1434946a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d383e74-7254-4c96-b91d-9ad70d40b179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a18d6cbbd3549ed8778a6bd07dd99dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:24Z,use_quota=True,user_id='5823d0f640af4a00b2ca49ee29345b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9cdbb4-b2c9-4cf1-8ec5-0c2e1bed0f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9cdbb4-b2c9-4cf1-8ec5-0c2e1bed0f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fc3f1f-f2c0-454d-b3a4-7c8bd7784b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fc3f1f-f2c0-454d-b3a4-7c8bd7784b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d383e74-7254-4c96-b91d-9ad70d40b179', 'volume_name': 'volume-7d383e74-7254-4c96-b91d-9ad70d40b179', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75519e80-2cf3-4f86-8403-b40c1806264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75519e80-2cf3-4f86-8403-b40c1806264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6bcf8a-e0f5-4f9a-a563-7a1963b6d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:24 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Volume 7d383e74-7254-4c96-b91d-9ad70d40b179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d383e74-7254-4c96-b91d-9ad70d40b179', 'volume_size': 1} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:24 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.650s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:56:24 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Converted 1024.00 MB image at 482.80 MB/s Apr 14 03:56:24 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 is being set with open permissions: ugo+rw Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:24 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 Apr 14 03:56:24 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:24 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" released by "_copy_volume_from_snapshot" :: held 4.221s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Deleting offline snapshot 8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 of volume 66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] snapshot_file for this snap is: volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274c7d9-efb9-4eff-9f45-4335438591ef]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:24 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:24 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:25 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.485s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cfb76e-a59c-418c-8e82-643296ccf8f9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:25 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:25 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:25 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:25 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:25 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:26 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.478s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:26 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78 Apr 14 03:56:26 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:26 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7.8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" returned: 0 in 0.413s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-8fc5a3d7-f434-472e-aeaf-d3fa18f17b78" released by "_delete_snapshot" :: held 1.886s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.961s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.533s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d383e74-7254-4c96-b91d-9ad70d40b179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a18d6cbbd3549ed8778a6bd07dd99dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:24Z,use_quota=True,user_id='5823d0f640af4a00b2ca49ee29345b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Creating volume 7d383e74-7254-4c96-b91d-9ad70d40b179 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:26 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5c9c08-7665-42f3-939f-78e75ba97c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fac25e-fc1d-444f-aa09-edac4565f4d6', 'volume_size': 1, 'source_volid': '66814d7a-c9b5-494e-99b9-b54d8863e7d7', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:26 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 1073741824 Apr 14 03:56:26 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a0b895-0f84-40f6-abbc-ceba073ba19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:26 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Volume volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 (64fac25e-fc1d-444f-aa09-edac4565f4d6): created successfully Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a0b895-0f84-40f6-abbc-ceba073ba19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:26 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Flow 'volume_create_manager' (d9dbd21a-8a1e-427f-9713-1dffa76a9af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-be8a22fd-589a-46bd-b802-876c416ee9e1 tempest-VolumeDependencyTests-268997772 None] Created volume successfully. Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-66814d7a-c9b5-494e-99b9-b54d8863e7d7-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "cinder-66814d7a-c9b5-494e-99b9-b54d8863e7d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:27 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-66814d7a-c9b5-494e-99b9-b54d8863e7d7" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 1073741824" returned: 0 in 0.527s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-66814d7a-c9b5-494e-99b9-b54d8863e7d7" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43abfd-33c4-4eb3-913e-5face3f07b5d]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:27 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 Apr 14 03:56:27 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:27 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:27 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:27 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179" returned: 0 in 0.424s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6bcf8a-e0f5-4f9a-a563-7a1963b6d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d383e74-7254-4c96-b91d-9ad70d40b179', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2abee00-3d0d-49af-8b05-7a0fa538dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Volume volume-7d383e74-7254-4c96-b91d-9ad70d40b179 (7d383e74-7254-4c96-b91d-9ad70d40b179): created successfully Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2abee00-3d0d-49af-8b05-7a0fa538dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Flow 'volume_create_manager' (6663a31b-7980-465c-95a9-d87178db0f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:27 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:27 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2c987952-3d29-4645-8e33-436902d895a9 tempest-CinderUnicodeTest-108541614 None] Created volume successfully. Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:27 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7 Apr 14 03:56:27 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:28 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-66814d7a-c9b5-494e-99b9-b54d8863e7d7" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-66814d7a-c9b5-494e-99b9-b54d8863e7d7" released by "delete_volume" :: held 0.943s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Created reservations ['3b3527d3-7d30-4350-b75b-3d6697a70332', '0736d67c-766a-4e32-9a08-b630fa2ec01b', '3d27c891-92bf-47d7-afd0-e19582bac21c', 'e710c03a-88b0-46d3-bd4e-70a66e217b3d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-64fac25e-fc1d-444f-aa09-edac4565f4d6-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:28 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:28 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "cinder-64fac25e-fc1d-444f-aa09-edac4565f4d6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c36b7b5-5e69-4f37-9aa0-319596efaeb3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:28 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 Apr 14 03:56:28 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Flow 'volume_create_manager' (2fb4d54c-441a-4138-bbfb-4ae315d62dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a7d43d-ddde-4ffa-bc56-f0bb55c4765a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a7d43d-ddde-4ffa-bc56-f0bb55c4765a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1312647044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa46452-86ce-4357-988f-a45392bedcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a18d6cbbd3549ed8778a6bd07dd99dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:29Z,use_quota=True,user_id='5823d0f640af4a00b2ca49ee29345b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba027986-dc1a-4dbf-93a9-6a0f7c7bb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba027986-dc1a-4dbf-93a9-6a0f7c7bb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dfcec9-d911-4fca-86a9-d4c37af8e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dfcec9-d911-4fca-86a9-d4c37af8e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa46452-86ce-4357-988f-a45392bedcd1', 'volume_name': 'volume-afa46452-86ce-4357-988f-a45392bedcd1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95667e3a-6f03-49b4-b20f-6a14bf52c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95667e3a-6f03-49b4-b20f-6a14bf52c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a039057-3f2d-4db6-a51d-6fb4fbd7457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:28 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Volume afa46452-86ce-4357-988f-a45392bedcd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa46452-86ce-4357-988f-a45392bedcd1', 'volume_size': 1} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1312647044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa46452-86ce-4357-988f-a45392bedcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a18d6cbbd3549ed8778a6bd07dd99dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:29Z,use_quota=True,user_id='5823d0f640af4a00b2ca49ee29345b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Creating volume afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:28 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:28 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 1073741824 Apr 14 03:56:28 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:28 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:28 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Deleted volume successfully. Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2ebf04de-fc11-4fc2-9b08-f1b72fb65a7b tempest-VolumeDependencyTests-268997772 None] Lock "cinder-66814d7a-c9b5-494e-99b9-b54d8863e7d7-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:28 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6" returned: 0 in 0.518s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:28 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6 Apr 14 03:56:28 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:29 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 1073741824" returned: 0 in 0.508s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:29 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 Apr 14 03:56:29 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:29 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-64fac25e-fc1d-444f-aa09-edac4565f4d6" returned: 0 in 0.441s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-64fac25e-fc1d-444f-aa09-edac4565f4d6" released by "delete_volume" :: held 0.981s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Created reservations ['5cb688b6-d17e-43f4-8fbc-749319236a0f', '0aa48f4c-78c8-488c-a7b1-7b24f1d329b6', 'bb3d7fec-6ee3-4b11-b839-429343818618', '4d4f9541-fefb-4532-8a80-922d9f66dd49'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:29 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:29 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:29 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a039057-3f2d-4db6-a51d-6fb4fbd7457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa46452-86ce-4357-988f-a45392bedcd1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d7c370-3eff-45ac-b440-43b6ecad7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:29 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Volume volume-afa46452-86ce-4357-988f-a45392bedcd1 (afa46452-86ce-4357-988f-a45392bedcd1): created successfully Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d7c370-3eff-45ac-b440-43b6ecad7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Flow 'volume_create_manager' (2fb4d54c-441a-4138-bbfb-4ae315d62dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1ae70629-5451-4bd1-b586-c8c014a50568 tempest-CinderUnicodeTest-108541614 None] Created volume successfully. Apr 14 03:56:29 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.446s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Deleted volume successfully. Apr 14 03:56:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aac10c3e-2aa5-4849-b791-790051d3ea6f tempest-VolumeDependencyTests-268997772 None] Lock "cinder-64fac25e-fc1d-444f-aa09-edac4565f4d6-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-cf1ea945-7fa8-4bbb-a168-731058330a80-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-cf1ea945-7fa8-4bbb-a168-731058330a80-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc7af24-878d-4c96-9bcb-edfa1c812fd5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:30 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 Apr 14 03:56:30 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Creating offline snapshot f0949607-55ae-4544-ba42-d1735f329b16 of volume afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e7aafc-a149-4166-a99b-dd98360863aa]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:30 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 Apr 14 03:56:30 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:31 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80" returned: 0 in 0.525s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:31 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80 Apr 14 03:56:31 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:31 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:31 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 1G Apr 14 03:56:31 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:31 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-cf1ea945-7fa8-4bbb-a168-731058330a80" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-quobyte-cf1ea945-7fa8-4bbb-a168-731058330a80" released by "delete_volume" :: held 0.969s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Created reservations ['e171731c-0533-4c3d-8d87-91e228703316', 'dec61bef-4027-44d3-a124-96d5fef4d40e', 'aa417392-b200-4b8b-a935-6bfa5b94bb67', '3920d6ab-4cca-495c-b566-b77a00fc5ea4'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:31 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:31 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:31 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 1G" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa46452-86ce-4357-988f-a45392bedcd1 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:31 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa46452-86ce-4357-988f-a45392bedcd1 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 Apr 14 03:56:31 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:32 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.492s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Deleted volume successfully. Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-99fa6755-6552-4725-8e86-bdc2a8bd0efc tempest-VolumeDependencyTests-268997772 None] Lock "cinder-cf1ea945-7fa8-4bbb-a168-731058330a80-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:32 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa46452-86ce-4357-988f-a45392bedcd1 -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16" returned: 0 in 0.479s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:32 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 is being set with open permissions: ugo+rw Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:32 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 Apr 14 03:56:32 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:32 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16" returned: 0 in 0.480s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:32 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info Apr 14 03:56:32 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:33 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info" returned: 0 in 0.408s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:33 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info is being set with open permissions: ugo+rw Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:33 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info Apr 14 03:56:33 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:33 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.info" returned: 0 in 0.408s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.885s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:33 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c194d60c-5717-4bbb-80c8-3c063053ce6b tempest-CinderUnicodeTest-108541614 None] Create snapshot completed successfully Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-f0949607-55ae-4544-ba42-d1735f329b16-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-f0949607-55ae-4544-ba42-d1735f329b16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:33 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-quobyte-f0949607-55ae-4544-ba42-d1735f329b16" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-f0949607-55ae-4544-ba42-d1735f329b16" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Deleting offline snapshot f0949607-55ae-4544-ba42-d1735f329b16 of volume afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] snapshot_file for this snap is: volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afbb58-17a3-47e2-bac6-af9475b4cf43]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:34 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 Apr 14 03:56:34 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:34 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afa46452-86ce-4357-988f-a45392bedcd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d5a77-7068-43e7-826e-afe33d1bd387]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:34 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 Apr 14 03:56:34 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:34 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:34 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 Apr 14 03:56:34 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:35 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16" returned: 0 in 0.437s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:35 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16 Apr 14 03:56:35 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:35 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1.f0949607-55ae-4544-ba42-d1735f329b16" returned: 0 in 0.402s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-f0949607-55ae-4544-ba42-d1735f329b16" released by "_delete_snapshot" :: held 1.814s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" released by "delete_snapshot" :: held 1.832s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Created reservations ['f8b5df44-c90e-40d8-9bd4-d80da1f0ea31', '921ca9ee-1a35-476b-99d4-6c40d2759c45', 'f766be53-44c3-4fc4-9836-0193ab179063', '8e4749c2-15e8-4efe-b72d-5aed64452927'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=238,cinder:SELECT=193,cinder:INSERT=65,cinder:DELETE=19 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:56:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Delete snapshot completed successfully. Apr 14 03:56:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-6351e697-ce7f-4514-8033-53b584497161 tempest-CinderUnicodeTest-108541614 None] Lock "cinder-f0949607-55ae-4544-ba42-d1735f329b16-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-afa46452-86ce-4357-988f-a45392bedcd1-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-afa46452-86ce-4357-988f-a45392bedcd1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b9880-bf33-4575-8086-38b2621332eb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:36 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 Apr 14 03:56:36 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:36 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:36 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1 Apr 14 03:56:36 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:37 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-afa46452-86ce-4357-988f-a45392bedcd1" returned: 0 in 0.402s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-afa46452-86ce-4357-988f-a45392bedcd1" released by "delete_volume" :: held 0.898s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Created reservations ['ed09f2eb-ac9c-4684-a5dd-368fac69127a', 'b88fed1d-d769-4b78-9f8e-fa3a4f71df46', 'df25d3e1-87be-43f6-ab55-b8fe4d74028c', 'cf9757d6-680c-495a-8448-140c38ce9bd8'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:37 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:37 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-7d383e74-7254-4c96-b91d-9ad70d40b179-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-7d383e74-7254-4c96-b91d-9ad70d40b179-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "cinder-quobyte-7d383e74-7254-4c96-b91d-9ad70d40b179" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-7d383e74-7254-4c96-b91d-9ad70d40b179" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bded33f-eebe-4546-bfbe-8bf0b440e357]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:37 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 Apr 14 03:56:37 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:37 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.430s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Deleted volume successfully. Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-254b9e83-36bd-43b0-9149-4e0fb86c4a8f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-afa46452-86ce-4357-988f-a45392bedcd1-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:37 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:37 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179 Apr 14 03:56:37 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:38 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-7d383e74-7254-4c96-b91d-9ad70d40b179" returned: 0 in 0.406s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-quobyte-7d383e74-7254-4c96-b91d-9ad70d40b179" released by "delete_volume" :: held 0.906s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=254,cinder:SELECT=179,cinder:INSERT=59,cinder:DELETE=24 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Created reservations ['046737db-b391-40d5-9e93-333de50af5ec', '27616798-c308-4e96-9328-2aa8768a62a2', 'ef501fb9-44cb-4f58-9c10-23d0bf1f6778', '096045ed-c9dd-4d4f-8aa4-2fa5a8040a18'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:38 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:38 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:38 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Deleted volume successfully. Apr 14 03:56:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-ccf0a245-975b-4ea2-86be-b4a74dce891f tempest-CinderUnicodeTest-108541614 None] Lock "cinder-7d383e74-7254-4c96-b91d-9ad70d40b179-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (8cc9215a-3c86-4395-ad60-944648125764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8256de3e-1219-4900-820f-3b86641caf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (56c306d9-582c-4586-86f4-beaf378a5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12dde12-4470-467f-bf92-39f09b356efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12dde12-4470-467f-bf92-39f09b356efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94094814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58eb42d-5137-4b0b-ba68-12742132f20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:45Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b0ff85-d266-433d-8247-3d4552099849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b0ff85-d266-433d-8247-3d4552099849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b946656a-fbce-4468-b028-83406dfc7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b946656a-fbce-4468-b028-83406dfc7eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58eb42d-5137-4b0b-ba68-12742132f20b', 'volume_name': 'volume-c58eb42d-5137-4b0b-ba68-12742132f20b', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c875cf09-2b12-4ce9-9813-c557a83091fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c875cf09-2b12-4ce9-9813-c557a83091fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3489f09-6182-41ba-a3d7-62556b0dd62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Volume c58eb42d-5137-4b0b-ba68-12742132f20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58eb42d-5137-4b0b-ba68-12742132f20b', 'volume_size': 1} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94094814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58eb42d-5137-4b0b-ba68-12742132f20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:45Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Creating volume c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:45 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:45 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b 1073741824 Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8256de3e-1219-4900-820f-3b86641caf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385621733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3040850e-5722-4923-8918-34298f97aa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:45Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1daacb4a-582b-4f40-b940-46e51c369146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1daacb4a-582b-4f40-b940-46e51c369146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61528e-b4ce-47de-97e6-b9247b19e2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61528e-b4ce-47de-97e6-b9247b19e2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3040850e-5722-4923-8918-34298f97aa26', 'volume_name': 'volume-3040850e-5722-4923-8918-34298f97aa26', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34c0a1b-a077-419b-bccb-3216fc471898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34c0a1b-a077-419b-bccb-3216fc471898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95940560-c401-4d38-aa0f-1b06ad2f36f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Volume 3040850e-5722-4923-8918-34298f97aa26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3040850e-5722-4923-8918-34298f97aa26', 'volume_size': 1} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (1ae9133a-b445-4609-a521-0f5722b76332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eda588-2720-4cda-ac64-d00eaa9534e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (467606b1-e415-488e-9314-918c6ddd5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c3543-d757-4ca7-933a-99880cf5d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09eda588-2720-4cda-ac64-d00eaa9534e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683010987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0a3784-4e99-4b19-a1c3-73c87d4f9329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1578692-5667-4a7b-9596-19706a271011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1578692-5667-4a7b-9596-19706a271011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7d4b6e-3f34-4153-89a6-103088d125dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7d4b6e-3f34-4153-89a6-103088d125dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0a3784-4e99-4b19-a1c3-73c87d4f9329', 'volume_name': 'volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cd6560-f1ed-48ac-aa63-47e27cc2bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cd6560-f1ed-48ac-aa63-47e27cc2bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0d695b-0a33-4b31-b6d3-0dfd2ca709dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Volume 3a0a3784-4e99-4b19-a1c3-73c87d4f9329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329', 'volume_size': 1} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c3543-d757-4ca7-933a-99880cf5d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-298983605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6da4af-5005-409a-a44a-f39727bb935e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec35374-cd74-4949-b2fa-69a63c30783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec35374-cd74-4949-b2fa-69a63c30783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6ee347-4127-42b4-8887-0367ca34c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6ee347-4127-42b4-8887-0367ca34c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6da4af-5005-409a-a44a-f39727bb935e', 'volume_name': 'volume-5c6da4af-5005-409a-a44a-f39727bb935e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630a36e4-29d1-4fd6-bb57-dd1db5a264bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630a36e4-29d1-4fd6-bb57-dd1db5a264bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414c35f2-7451-4b4c-a086-d1876dd5ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:45 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume 5c6da4af-5005-409a-a44a-f39727bb935e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6da4af-5005-409a-a44a-f39727bb935e', 'volume_size': 1} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:45 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (a1ae50db-c332-4318-af3c-0e004d7a8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a3b487-9faa-4129-a1f4-1356aa70657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a3b487-9faa-4129-a1f4-1356aa70657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521628498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd9f8c-e5d0-4c17-a817-bef2a72189b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c5e06-85f3-4f16-8482-e7d72193c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c5e06-85f3-4f16-8482-e7d72193c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f86c6f-ba46-43bc-8ac6-73c40f081b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f86c6f-ba46-43bc-8ac6-73c40f081b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbd9f8c-e5d0-4c17-a817-bef2a72189b0', 'volume_name': 'volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974d881-e729-4016-b830-b426a167d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e974d881-e729-4016-b830-b426a167d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87edcf6-35ff-4165-83b4-ff539b03d551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Volume ebbd9f8c-e5d0-4c17-a817-bef2a72189b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0', 'volume_size': 1} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (125028d9-748d-4b49-86fd-37764f4e6ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a054ed17-ee2f-4a9a-8a87-4ab2765cccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a054ed17-ee2f-4a9a-8a87-4ab2765cccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1688405038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c01229c-2986-454e-91ff-65bf9ef1ba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e762b678-1a72-45a3-87d0-d4e340a00d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e762b678-1a72-45a3-87d0-d4e340a00d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b329aa3-7fe8-49d9-80f6-cc92e69e947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b329aa3-7fe8-49d9-80f6-cc92e69e947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c01229c-2986-454e-91ff-65bf9ef1ba51', 'volume_name': 'volume-0c01229c-2986-454e-91ff-65bf9ef1ba51', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99852fe7-2b99-493c-a7c5-8bdb9ce2242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99852fe7-2b99-493c-a7c5-8bdb9ce2242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988b5850-071d-47d3-a8b9-72c4692a040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Volume 0c01229c-2986-454e-91ff-65bf9ef1ba51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c01229c-2986-454e-91ff-65bf9ef1ba51', 'volume_size': 1} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:46 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (8f906b91-8d4a-4751-89ae-d5e249b791a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0edf3b7-b86d-4b34-9589-e0121354b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b 1073741824" returned: 0 in 0.723s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0edf3b7-b86d-4b34-9589-e0121354b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245169230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a059af-c925-4bde-85f1-ae2e865a88ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6941332c-bd59-4e34-a3c3-ac479405620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6941332c-bd59-4e34-a3c3-ac479405620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065bb0f5-ffea-4b78-9741-07fd68dbbcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065bb0f5-ffea-4b78-9741-07fd68dbbcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a059af-c925-4bde-85f1-ae2e865a88ca', 'volume_name': 'volume-e3a059af-c925-4bde-85f1-ae2e865a88ca', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a8746-5319-4e7f-b6cc-037abac5e8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a8746-5319-4e7f-b6cc-037abac5e8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cade989b-e37f-4f3e-acf9-996ad345912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Volume e3a059af-c925-4bde-85f1-ae2e865a88ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a059af-c925-4bde-85f1-ae2e865a88ca', 'volume_size': 1} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:46 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:56:46 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:46 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385621733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3040850e-5722-4923-8918-34298f97aa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:45Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Creating volume 3040850e-5722-4923-8918-34298f97aa26 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3489f09-6182-41ba-a3d7-62556b0dd62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58eb42d-5137-4b0b-ba68-12742132f20b', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 1073741824 Apr 14 03:56:46 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15c53ba-9c73-41f6-9b58-eac6264ff5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Volume volume-c58eb42d-5137-4b0b-ba68-12742132f20b (c58eb42d-5137-4b0b-ba68-12742132f20b): created successfully Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15c53ba-9c73-41f6-9b58-eac6264ff5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:46 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (56c306d9-582c-4586-86f4-beaf378a5329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-757b4562-5084-4063-90e0-01c468071b89 tempest-VolumeDependencyTests-2089132427 None] Created volume successfully. Apr 14 03:56:47 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 1073741824" returned: 0 in 0.566s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:47 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 Apr 14 03:56:47 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:47 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26" returned: 0 in 0.462s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.069s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683010987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0a3784-4e99-4b19-a1c3-73c87d4f9329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:47 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Creating volume 3a0a3784-4e99-4b19-a1c3-73c87d4f9329 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:48 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95940560-c401-4d38-aa0f-1b06ad2f36f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3040850e-5722-4923-8918-34298f97aa26', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:48 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 1073741824 Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a19533-a6b9-4f0d-acbc-d601a610fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:48 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:48 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Volume volume-3040850e-5722-4923-8918-34298f97aa26 (3040850e-5722-4923-8918-34298f97aa26): created successfully Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a19533-a6b9-4f0d-acbc-d601a610fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (8cc9215a-3c86-4395-ad60-944648125764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:48 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e86f7566-78e7-4ad5-8b9e-f70877b99006 tempest-CreateVolumesFromImageTest-91736752 None] Created volume successfully. Apr 14 03:56:48 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 1073741824" returned: 0 in 0.604s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:48 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:48 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 Apr 14 03:56:48 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:49 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.185s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-298983605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6da4af-5005-409a-a44a-f39727bb935e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume 5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:49 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0d695b-0a33-4b31-b6d3-0dfd2ca709dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91c4ca6-7f37-4f2f-8c71-2a06cf3d67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:49 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e 1073741824 Apr 14 03:56:49 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:49 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Volume volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 (3a0a3784-4e99-4b19-a1c3-73c87d4f9329): created successfully Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91c4ca6-7f37-4f2f-8c71-2a06cf3d67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (1ae9133a-b445-4609-a521-0f5722b76332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:49 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ad09afc4-56b7-484c-a60c-691d1a8038c4 tempest-CreateVolumesFromImageTest-91736752 None] Created volume successfully. Apr 14 03:56:49 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e 1073741824" returned: 0 in 0.544s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:49 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:49 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e Apr 14 03:56:49 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:50 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.128s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521628498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd9f8c-e5d0-4c17-a817-bef2a72189b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Creating volume ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:50 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414c35f2-7451-4b4c-a086-d1876dd5ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6da4af-5005-409a-a44a-f39727bb935e', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955913bd-7f08-4dc8-a1d6-be13a52902d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:50 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-5c6da4af-5005-409a-a44a-f39727bb935e (5c6da4af-5005-409a-a44a-f39727bb935e): created successfully Apr 14 03:56:50 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 1073741824 Apr 14 03:56:50 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955913bd-7f08-4dc8-a1d6-be13a52902d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (467606b1-e415-488e-9314-918c6ddd5736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:50 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b0fa5721-0617-44cf-9cbc-05543bfd2e37 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:56:50 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 1073741824" returned: 0 in 0.632s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:50 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:50 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 Apr 14 03:56:50 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:51 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" returned: 0 in 0.504s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.077s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1688405038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c01229c-2986-454e-91ff-65bf9ef1ba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Creating volume 0c01229c-2986-454e-91ff-65bf9ef1ba51 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:51 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87edcf6-35ff-4165-83b4-ff539b03d551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674b523-ce00-4d66-ab2b-f3eb11f6b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:51 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 1073741824 Apr 14 03:56:51 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:51 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Volume volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 (ebbd9f8c-e5d0-4c17-a817-bef2a72189b0): created successfully Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674b523-ce00-4d66-ab2b-f3eb11f6b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (a1ae50db-c332-4318-af3c-0e004d7a8725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:51 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d2a497aa-a1cf-4101-9dd3-31c589c6559c tempest-CreateVolumesFromImageTest-91736752 None] Created volume successfully. Apr 14 03:56:51 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 1073741824" returned: 0 in 0.542s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:51 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:51 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 Apr 14 03:56:51 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:52 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51" returned: 0 in 0.498s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.978s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245169230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a059af-c925-4bde-85f1-ae2e865a88ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d321d65750574192a8410389a65424c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:46Z,use_quota=True,user_id='64fdc4685e274f82aae22f9e800f6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Creating volume e3a059af-c925-4bde-85f1-ae2e865a88ca {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:56:52 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988b5850-071d-47d3-a8b9-72c4692a040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c01229c-2986-454e-91ff-65bf9ef1ba51', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da44d69b-f81c-4f87-8a2d-b863bd82b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:52 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca 1073741824 Apr 14 03:56:52 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:52 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Volume volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 (0c01229c-2986-454e-91ff-65bf9ef1ba51): created successfully Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da44d69b-f81c-4f87-8a2d-b863bd82b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (125028d9-748d-4b49-86fd-37764f4e6ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:52 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-159fca3c-7b39-4da4-a48f-05668c9e1edc tempest-CreateVolumesFromImageTest-91736752 None] Created volume successfully. Apr 14 03:56:52 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:52 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca 1073741824" returned: 0 in 0.557s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:53 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca Apr 14 03:56:53 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:53 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca" returned: 0 in 0.431s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.598s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cade989b-e37f-4f3e-acf9-996ad345912f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a059af-c925-4bde-85f1-ae2e865a88ca', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858579c8-5fa8-45c3-9ac5-5181abe8db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Creating offline snapshot 038a1053-bb7c-4f0e-9b3b-5312b70a7fcd of volume c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:56:53 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Volume volume-e3a059af-c925-4bde-85f1-ae2e865a88ca (e3a059af-c925-4bde-85f1-ae2e865a88ca): created successfully Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858579c8-5fa8-45c3-9ac5-5181abe8db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Flow 'volume_create_manager' (8f906b91-8d4a-4751-89ae-d5e249b791a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beff5eb-4e86-4285-9bf9-4426d74d9bbd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:53 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:53 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a68a1c51-7aeb-46ef-bccf-bfc68ad29978 tempest-CreateVolumesFromImageTest-91736752 None] Created volume successfully. Apr 14 03:56:53 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:56:53 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-e3a059af-c925-4bde-85f1-ae2e865a88ca-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-e3a059af-c925-4bde-85f1-ae2e865a88ca-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-quobyte-e3a059af-c925-4bde-85f1-ae2e865a88ca" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-e3a059af-c925-4bde-85f1-ae2e865a88ca" acquired by "delete_volume" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:54 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.610s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740e21c-b094-45e3-a9f4-2c68c162d5fc]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:54 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd 1G Apr 14 03:56:54 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:54 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca Apr 14 03:56:54 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:54 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca" returned: 0 in 0.585s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:54 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd 1G" returned: 0 in 0.618s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:54 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c58eb42d-5137-4b0b-ba68-12742132f20b -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:54 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca Apr 14 03:56:54 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:54 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c58eb42d-5137-4b0b-ba68-12742132f20b -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:56:54 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:55 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e3a059af-c925-4bde-85f1-ae2e865a88ca" returned: 0 in 0.474s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-e3a059af-c925-4bde-85f1-ae2e865a88ca" released by "delete_volume" :: held 1.090s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Created reservations ['8686411b-f011-43de-a702-e99e7dee2256', 'd87af10e-7349-4f25-8554-9e124e5206dc', 'eb68efdb-926b-4dbf-a131-cffaf3e7e996', '3e991dd5-7068-4679-a7a2-d79e3418bd33'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:55 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:55 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:55 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c58eb42d-5137-4b0b-ba68-12742132f20b -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.600s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:55 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd is being set with open permissions: ugo+rw Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:55 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:56:55 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:55 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.550s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:55 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Deleted volume successfully. Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-1f6a5d4e-4283-41cb-908a-3040f7e6cc65 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-e3a059af-c925-4bde-85f1-ae2e865a88ca-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:55 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.539s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:55 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:55 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info Apr 14 03:56:55 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-0c01229c-2986-454e-91ff-65bf9ef1ba51-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-0c01229c-2986-454e-91ff-65bf9ef1ba51-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-quobyte-0c01229c-2986-454e-91ff-65bf9ef1ba51" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-0c01229c-2986-454e-91ff-65bf9ef1ba51" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86ad86-c29a-48c4-8762-cc62800a126f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:56 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info" returned: 0 in 0.514s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:56 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info is being set with open permissions: ugo+rw Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:56 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 Apr 14 03:56:56 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:56 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info Apr 14 03:56:56 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:56 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51" returned: 0 in 0.622s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:56 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51 Apr 14 03:56:56 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:56 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:56 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.info" returned: 0 in 0.605s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.565s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.782s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating offline snapshot c633c4cd-4e07-4596-879d-0d77250e353e of volume 5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:56:57 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-ffac93ea-ee05-486f-b240-e46de9c1c43b tempest-VolumeDependencyTests-2089132427 None] Create snapshot completed successfully Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e9615-160f-4b7f-ac21-e581f20aecdc]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:57 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e Apr 14 03:56:57 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:57 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0c01229c-2986-454e-91ff-65bf9ef1ba51" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-0c01229c-2986-454e-91ff-65bf9ef1ba51" released by "delete_volume" :: held 1.209s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (dec514d0-d9cb-491f-8ebf-5e4eb3ffc430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f54451-e0ae-47be-a6a8-845b76113815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Created reservations ['9b94633d-a46b-4afa-9cfa-de7003c58f61', '51e6a5e4-1940-43e3-be20-5f6d74882903', 'cee4021c-2607-4fe7-913b-69f99fbd772c', '11002148-8eca-414c-9e34-ac25dc702e53'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f54451-e0ae-47be-a6a8-845b76113815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1145962388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caec173-b136-43f7-84c3-bbefa703d2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=038a1053-bb7c-4f0e-9b3b-5312b70a7fcd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:58Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429c9c7d-f1a0-4b27-94bd-9750d49e0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429c9c7d-f1a0-4b27-94bd-9750d49e0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dda4fc-2b2d-44a7-b366-8eb12da10ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dda4fc-2b2d-44a7-b366-8eb12da10ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0caec173-b136-43f7-84c3-bbefa703d2ec', 'volume_name': 'volume-0caec173-b136-43f7-84c3-bbefa703d2ec', 'volume_size': 1, 'snapshot_id': '038a1053-bb7c-4f0e-9b3b-5312b70a7fcd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeb0419-157b-4567-a1a6-262ef951e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeb0419-157b-4567-a1a6-262ef951e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd26001-a2b6-475b-bc87-73d7c8e65da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Volume 0caec173-b136-43f7-84c3-bbefa703d2ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0caec173-b136-43f7-84c3-bbefa703d2ec', 'volume_size': 1, 'snapshot_id': '038a1053-bb7c-4f0e-9b3b-5312b70a7fcd'} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Flow 'volume_create_manager' (72a8cd29-3189-459e-b6b6-f4cd7473febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb6e49-be17-43f1-ae29-309d1049861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e" returned: 0 in 0.708s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:57 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e 1G Apr 14 03:56:57 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb6e49-be17-43f1-ae29-309d1049861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2041077469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f903a4a0-7391-4fd7-b44f-0e182de23b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2aebc6f5949a381d6e6d7617f1532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:58Z,use_quota=True,user_id='ed0e02ef0e714a3f9ee0a7b1d8eb48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a820eb-c215-4abe-82f7-3906cb74922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a820eb-c215-4abe-82f7-3906cb74922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f65fb13-41e2-4bac-be9b-8dcd422be098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f65fb13-41e2-4bac-be9b-8dcd422be098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f903a4a0-7391-4fd7-b44f-0e182de23b1c', 'volume_name': 'volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117742fe-f761-4a70-8e17-75078f2e6e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117742fe-f761-4a70-8e17-75078f2e6e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3b6371-d3a7-4d24-bfdd-0e78045c37b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:56:57 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Volume f903a4a0-7391-4fd7-b44f-0e182de23b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c', 'volume_size': 1} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:57 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:57 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:57 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:58 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.422s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:58 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Deleted volume successfully. Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-10ac4938-46a4-47c1-9a5c-3f0343eee32a tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-0c01229c-2986-454e-91ff-65bf9ef1ba51-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:58 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e 1G" returned: 0 in 0.532s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6da4af-5005-409a-a44a-f39727bb935e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:58 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6da4af-5005-409a-a44a-f39727bb935e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e Apr 14 03:56:58 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-quobyte-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd2b58b-bc9f-478f-9898-631dd7f8408b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:58 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 Apr 14 03:56:58 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:58 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6da4af-5005-409a-a44a-f39727bb935e -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:58 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e is being set with open permissions: ugo+rw Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:58 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e Apr 14 03:56:58 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_service.periodic_task [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82370) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:58 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:58 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:58 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:59 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:59 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0 Apr 14 03:56:59 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:59 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e" returned: 0 in 0.423s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:59 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info Apr 14 03:56:59 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:59 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.417s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7ec72a65-24be-42ff-ae31-a877e5472d65 None None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:56:59 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" returned: 0 in 0.421s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0" released by "delete_volume" :: held 0.980s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Created reservations ['41cdefdf-ece1-4646-a59f-df08c76be37e', '5d26950d-e487-44c9-9cb8-52d4072db5d4', 'b77cbc61-25af-47a1-94f2-93d55b78bc87', 'c741f1d1-e9d8-4ef4-82ca-6203f99aeea6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:59 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:56:59 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:56:59 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:56:59 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info is being set with open permissions: ugo+rw Apr 14 03:56:59 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:56:59 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info Apr 14 03:56:59 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:00 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.411s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Deleted volume successfully. Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b4a3a5fa-0d6f-460b-951c-ca149a84a9b5 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-ebbd9f8c-e5d0-4c17-a817-bef2a72189b0-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:00 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.info" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.403s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-0caec173-b136-43f7-84c3-bbefa703d2ec" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-0caec173-b136-43f7-84c3-bbefa703d2ec" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Creating volume 0caec173-b136-43f7-84c3-bbefa703d2ec from snapshot 038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:00 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-231aa8c2-be6a-4b56-ace8-282e139168a0 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Create snapshot completed successfully Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] snapshot: 038a1053-bb7c-4f0e-9b3b-5312b70a7fcd, volume: 0caec173-b136-43f7-84c3-bbefa703d2ec, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d346a1-16e1-4fb0-8b51-9b60821b8405]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:00 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:57:00 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:00 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.493s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c58eb42d-5137-4b0b-ba68-12742132f20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[10757ec3-ca61-4227-b081-b30ba58a99fb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-3a0a3784-4e99-4b19-a1c3-73c87d4f9329-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-3a0a3784-4e99-4b19-a1c3-73c87d4f9329-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-quobyte-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" acquired by "delete_volume" :: waited 0.019s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:00 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:57:00 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d822ca-9d36-46fb-b79a-4deb178443ed]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:00 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 Apr 14 03:57:00 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (7d994fe5-124d-4524-b507-bb3bedc50251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1dc11-efb4-401c-b8f6-d8c97e18b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1dc11-efb4-401c-b8f6-d8c97e18b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505890230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bd278f-8107-44e1-bc5b-f10a5f5e0b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da77074-e1fd-45b0-8a49-4c01a4703424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da77074-e1fd-45b0-8a49-4c01a4703424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b98d70-a032-468d-bf21-391324ecf6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b98d70-a032-468d-bf21-391324ecf6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bd278f-8107-44e1-bc5b-f10a5f5e0b6a', 'volume_name': 'volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010db2c3-d4d9-4513-9992-9156b4082d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010db2c3-d4d9-4513-9992-9156b4082d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820b7bef-1049-4eba-8f45-3b17d197f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:00 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume 21bd278f-8107-44e1-bc5b-f10a5f5e0b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a', 'volume_size': 1} Apr 14 03:57:00 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (f68c9433-4fc3-46a1-a1b4-dda2ee2c27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d784b1-ef19-45ee-9a28-e74ff80c69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d784b1-ef19-45ee-9a28-e74ff80c69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227882160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72423227-f95f-4545-98f1-4ef9bf4d752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407eba0-04dd-46e1-83c9-8bcfa2b1560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407eba0-04dd-46e1-83c9-8bcfa2b1560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc8e2c7-0f81-4f3a-8154-2497489774cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc8e2c7-0f81-4f3a-8154-2497489774cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72423227-f95f-4545-98f1-4ef9bf4d752d', 'volume_name': 'volume-72423227-f95f-4545-98f1-4ef9bf4d752d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b91ac4-e80b-4ea4-a646-b79d4754cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b91ac4-e80b-4ea4-a646-b79d4754cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a9bd63-f489-44ff-b619-ee4a5ae90e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume 72423227-f95f-4545-98f1-4ef9bf4d752d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72423227-f95f-4545-98f1-4ef9bf4d752d', 'volume_size': 1} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:01 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (a3fb9d4b-97be-4d7c-81fe-e43651ab176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a733403-bede-4787-a451-bad95457b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.611s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:01 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec Apr 14 03:57:01 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a733403-bede-4787-a451-bad95457b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502120689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f141da9f-bc58-4637-871b-694bdc7c2221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415e9e4-18bc-4bab-94a5-55ce48f913c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415e9e4-18bc-4bab-94a5-55ce48f913c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c89346-e0f0-4bac-a4e3-b63ac0942181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c89346-e0f0-4bac-a4e3-b63ac0942181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f141da9f-bc58-4637-871b-694bdc7c2221', 'volume_name': 'volume-f141da9f-bc58-4637-871b-694bdc7c2221', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc37f93-7d74-4598-8cd9-77900d62c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc37f93-7d74-4598-8cd9-77900d62c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3085b943-f662-4f9c-8668-ae5174727b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume f141da9f-bc58-4637-871b-694bdc7c2221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f141da9f-bc58-4637-871b-694bdc7c2221', 'volume_size': 1} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:01 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" returned: 0 in 0.612s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:01 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329 Apr 14 03:57:01 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (9af8f4fd-c335-4ccc-adaf-c65fe830bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db59c89c-6821-4744-9812-846e59badde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db59c89c-6821-4744-9812-846e59badde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664983888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbcb0bd-50fc-4b75-b897-2f0dcda4d915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd7d545-cd2e-427d-a4c6-648ad7bc4b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd7d545-cd2e-427d-a4c6-648ad7bc4b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a423958-5f93-4bb7-aeb2-8351c0d10369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a423958-5f93-4bb7-aeb2-8351c0d10369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbcb0bd-50fc-4b75-b897-2f0dcda4d915', 'volume_name': 'volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1661580-e55f-4d5c-911f-c05f163bb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1661580-e55f-4d5c-911f-c05f163bb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07de6ce0-33ae-4c42-b51d-c5dff41d5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume ccbcb0bd-50fc-4b75-b897-2f0dcda4d915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915', 'volume_size': 1} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (e9bd2a08-4de9-41bb-9fe4-c6d8d7656e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7b5d7f-952d-4171-b0be-e9645b6cdd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7b5d7f-952d-4171-b0be-e9645b6cdd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277491397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ee2808-3e92-436c-808b-1ea3415ee8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:02Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8daaf84-844e-4180-b935-022ba6f79f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8daaf84-844e-4180-b935-022ba6f79f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c123000-8264-4dff-a0dc-268b4dfa7c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c123000-8264-4dff-a0dc-268b4dfa7c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ee2808-3e92-436c-808b-1ea3415ee8e1', 'volume_name': 'volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeb1b9b-4e16-4c5d-a45c-20f253f3c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeb1b9b-4e16-4c5d-a45c-20f253f3c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8837f0e8-eeef-4b35-af41-43924a9dd19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:01 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume f7ee2808-3e92-436c-808b-1ea3415ee8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1', 'volume_size': 1} Apr 14 03:57:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:02 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" returned: 0 in 0.648s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-3a0a3784-4e99-4b19-a1c3-73c87d4f9329" released by "delete_volume" :: held 1.306s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Created reservations ['241a740f-8dbf-43f9-a78c-0a4a0da6b02c', '65f9f6a5-f812-4e97-a00d-f22f93fb70e5', 'd96190bf-4010-435d-991a-61d3854d1ab4', 'e558e030-c414-4d7a-a0c8-093dded107fe'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:02 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:02 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-3040850e-5722-4923-8918-34298f97aa26-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:02 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-3040850e-5722-4923-8918-34298f97aa26-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "cinder-quobyte-3040850e-5722-4923-8918-34298f97aa26" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-3040850e-5722-4923-8918-34298f97aa26" acquired by "delete_volume" :: waited 0.060s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78982a8-f8cf-4d30-9cbc-c9af59aceb25]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:03 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 Apr 14 03:57:03 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:03 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 1.287s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:03 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Deleted volume successfully. Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-aeca5aa2-76e6-4da2-af75-ba8ff6b8f3c6 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-3a0a3784-4e99-4b19-a1c3-73c87d4f9329-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:03 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec" returned: 0 in 2.287s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab3b49e-130a-4328-8173-ffc00463130c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:03 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:57:03 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:03 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26" returned: 0 in 0.638s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:03 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:03 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26 Apr 14 03:57:03 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:04 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.611s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:57:04 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Converted 1024.00 MB image at 447.60 MB/s Apr 14 03:57:04 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec is being set with open permissions: ugo+rw Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:04 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec Apr 14 03:57:04 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:04 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-3040850e-5722-4923-8918-34298f97aa26" returned: 0 in 0.412s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-quobyte-3040850e-5722-4923-8918-34298f97aa26" released by "delete_volume" :: held 1.106s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Created reservations ['66a56b21-8513-4ca8-bb57-42173b1f7601', '49df27ea-17da-4de2-a305-ced8f3d53965', '3def1672-df3f-4f18-8fd3-a1901c017506', 'c61e5348-e552-4a83-b47f-82cc40bac1c4'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:04 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:04 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:04 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec" returned: 0 in 0.406s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" released by "_copy_volume_from_snapshot" :: held 4.461s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-0caec173-b136-43f7-84c3-bbefa703d2ec" released by "_create_volume_from_snapshot" :: held 4.480s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.497s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.783s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2041077469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f903a4a0-7391-4fd7-b44f-0e182de23b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2aebc6f5949a381d6e6d7617f1532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:56:58Z,use_quota=True,user_id='ed0e02ef0e714a3f9ee0a7b1d8eb48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Creating volume f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:04 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:04 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c 1073741824 Apr 14 03:57:04 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd26001-a2b6-475b-bc87-73d7c8e65da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caec173-b136-43f7-84c3-bbefa703d2ec', 'volume_size': 1, 'snapshot_id': '038a1053-bb7c-4f0e-9b3b-5312b70a7fcd'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3162ccb-ba17-4045-9dee-c9ccf5d034af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:04 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Volume volume-0caec173-b136-43f7-84c3-bbefa703d2ec (0caec173-b136-43f7-84c3-bbefa703d2ec): created successfully Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3162ccb-ba17-4045-9dee-c9ccf5d034af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (dec514d0-d9cb-491f-8ebf-5e4eb3ffc430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0193131a-31d0-4592-bdb8-864b5ab6c395 tempest-VolumeDependencyTests-2089132427 None] Created volume successfully. Apr 14 03:57:04 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.427s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:04 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Deleted volume successfully. Apr 14 03:57:04 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7da51079-0d6f-4001-91e4-5fe84b76f711 tempest-CreateVolumesFromImageTest-91736752 None] Lock "cinder-3040850e-5722-4923-8918-34298f97aa26-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Deleting offline snapshot 038a1053-bb7c-4f0e-9b3b-5312b70a7fcd of volume c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] snapshot_file for this snap is: volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7fa89-3d7e-4433-acdb-3bb31aaeb4b0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:05 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c 1073741824" returned: 0 in 0.525s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:05 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:57:05 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:05 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:05 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:05 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.523s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c58eb42d-5137-4b0b-ba68-12742132f20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b0785-90c6-4f52-8e25-4b75c6c16210]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:05 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.482s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505890230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bd278f-8107-44e1-bc5b-f10a5f5e0b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume 21bd278f-8107-44e1-bc5b-f10a5f5e0b6a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:05 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:05 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:57:05 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3b6371-d3a7-4d24-bfdd-0e78045c37b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa521a30-3ca9-49ab-aa28-59c6c3f8304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:05 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a 1073741824 Apr 14 03:57:05 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:05 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Volume volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c (f903a4a0-7391-4fd7-b44f-0e182de23b1c): created successfully Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa521a30-3ca9-49ab-aa28-59c6c3f8304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:05 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Flow 'volume_create_manager' (72a8cd29-3189-459e-b6b6-f4cd7473febe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:05 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b301e355-5892-41aa-b565-d3ee6a09ac73 tempest-SnapshotDependencyTests-376018297 None] Created volume successfully. Apr 14 03:57:06 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.651s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:06 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a 1073741824" returned: 0 in 0.603s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:06 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:57:06 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:06 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a Apr 14 03:57:06 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:06 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.537s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:06 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" returned: 0 in 0.510s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227882160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72423227-f95f-4545-98f1-4ef9bf4d752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume 72423227-f95f-4545-98f1-4ef9bf4d752d {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:06 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd Apr 14 03:57:06 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:06 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820b7bef-1049-4eba-8f45-3b17d197f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7099689f-799b-4de5-9704-520d59a6eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:06 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a (21bd278f-8107-44e1-bc5b-f10a5f5e0b6a): created successfully Apr 14 03:57:06 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d 1073741824 Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7099689f-799b-4de5-9704-520d59a6eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:06 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (7d994fe5-124d-4524-b507-bb3bedc50251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:06 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-cf89fe92-06f4-4bfc-bdb1-22a524c2e6b4 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (8345df82-3b5e-4347-a9e0-eddb88e7a06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:06 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997648ba-bea8-4b7a-9765-5a1a7ea34751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997648ba-bea8-4b7a-9765-5a1a7ea34751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1228694600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3159815-49d3-4120-b2a4-fdeeb8d9193a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:07Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb457b-48ea-41f7-af75-560f466e8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb457b-48ea-41f7-af75-560f466e8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0331a87-9240-4b68-a876-c675786a75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0331a87-9240-4b68-a876-c675786a75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3159815-49d3-4120-b2a4-fdeeb8d9193a', 'volume_name': 'volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad39e950-82b2-4ff9-8e71-57e5f4eac295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad39e950-82b2-4ff9-8e71-57e5f4eac295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ae2c99-eb5d-4eee-a50a-fe9e82e9ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume f3159815-49d3-4120-b2a4-fdeeb8d9193a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a', 'volume_size': 1} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:07 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b.038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" returned: 0 in 0.430s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd" released by "_delete_snapshot" :: held 2.192s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" released by "delete_snapshot" :: held 2.208s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Created reservations ['09ca413e-5cd4-4e9b-b3a3-c3d0f7948601', '3e69a53b-80f0-4153-8a16-28e00ff69b1e', '9356027b-6e8c-42a5-965c-a5fe469f9851', '5c2d63a9-9a7b-4887-8fb8-7ab258e7b8b2'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:07 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Delete snapshot completed successfully. Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-960c700c-9d0c-48c1-85c3-3ab621d759f4 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-038a1053-bb7c-4f0e-9b3b-5312b70a7fcd-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:07 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d 1073741824" returned: 0 in 0.581s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:07 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d Apr 14 03:57:07 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:07 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d" returned: 0 in 0.403s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.490s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502120689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f141da9f-bc58-4637-871b-694bdc7c2221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume f141da9f-bc58-4637-871b-694bdc7c2221 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:07 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a9bd63-f489-44ff-b619-ee4a5ae90e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72423227-f95f-4545-98f1-4ef9bf4d752d', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 1073741824 Apr 14 03:57:07 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ab1aa-f309-49ab-8614-4fea936b30b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:07 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-72423227-f95f-4545-98f1-4ef9bf4d752d (72423227-f95f-4545-98f1-4ef9bf4d752d): created successfully Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7ab1aa-f309-49ab-8614-4fea936b30b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:07 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (f68c9433-4fc3-46a1-a1b4-dda2ee2c27ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:07 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9f79d61a-ba99-491a-9a5a-89d8d98684ce tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-c58eb42d-5137-4b0b-ba68-12742132f20b-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-c58eb42d-5137-4b0b-ba68-12742132f20b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc73290-9588-4444-a561-038e36f0ce1b]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:08 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:57:08 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:08 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 1073741824" returned: 0 in 0.502s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:08 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 Apr 14 03:57:08 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:08 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.483s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:08 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b Apr 14 03:57:08 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:08 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.229s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664983888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbcb0bd-50fc-4b75-b897-2f0dcda4d915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:01Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:08 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3085b943-f662-4f9c-8668-ae5174727b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f141da9f-bc58-4637-871b-694bdc7c2221', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:08 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 1073741824 Apr 14 03:57:08 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f337f4a-b2e2-4157-87bb-b9e6c413ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:08 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-f141da9f-bc58-4637-871b-694bdc7c2221 (f141da9f-bc58-4637-871b-694bdc7c2221): created successfully Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f337f4a-b2e2-4157-87bb-b9e6c413ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:08 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (a3fb9d4b-97be-4d7c-81fe-e43651ab176d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:08 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-441f449e-5076-470f-9905-08da17d7ee31 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:57:09 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-c58eb42d-5137-4b0b-ba68-12742132f20b" returned: 0 in 0.425s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-c58eb42d-5137-4b0b-ba68-12742132f20b" released by "delete_volume" :: held 0.939s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Created reservations ['43ebc782-354b-46f8-b089-7ab922b08403', '77d221ca-a15d-4f75-824b-30d4c697671e', '9ae79b85-cf74-4c4e-97a5-323f082e1a9b', '04df0a49-e3c2-49ed-b822-9cfd2aefc24e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:09 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:09 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:09 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 1073741824" returned: 0 in 0.510s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:09 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 Apr 14 03:57:09 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (72848382-b495-41e9-a964-24a9ecf9baae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ce0262-cab3-4a77-a8bc-fffd34d4fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ce0262-cab3-4a77-a8bc-fffd34d4fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-777163127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023854b-dae2-4487-94fb-c88cf4afe6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:09Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f370ba69-2082-4948-8049-1f5ab18579d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f370ba69-2082-4948-8049-1f5ab18579d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe85998-657a-46ff-b474-5fee99bd4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe85998-657a-46ff-b474-5fee99bd4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f023854b-dae2-4487-94fb-c88cf4afe6cc', 'volume_name': 'volume-f023854b-dae2-4487-94fb-c88cf4afe6cc', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cfc1f3-5d1e-4edc-870b-fe29279b1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cfc1f3-5d1e-4edc-870b-fe29279b1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6be7b8-a784-4672-8e2d-85d2a05a999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Volume f023854b-dae2-4487-94fb-c88cf4afe6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f023854b-dae2-4487-94fb-c88cf4afe6cc', 'volume_size': 1} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:09 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Deleted volume successfully. Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4f91df85-6059-4d54-8f10-4f52a4bfcec8 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-c58eb42d-5137-4b0b-ba68-12742132f20b-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:09 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" returned: 0 in 0.423s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.062s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277491397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ee2808-3e92-436c-808b-1ea3415ee8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c13cf3bb55b45fda69e5e0835b4155e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:02Z,use_quota=True,user_id='ae2dde79676b495bb18db72d4ecde015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Creating volume f7ee2808-3e92-436c-808b-1ea3415ee8e1 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:09 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07de6ce0-33ae-4c42-b51d-c5dff41d5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c220c9-a0d2-4bae-8502-636164a67f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:09 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 1073741824 Apr 14 03:57:09 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:09 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 (ccbcb0bd-50fc-4b75-b897-2f0dcda4d915): created successfully Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c220c9-a0d2-4bae-8502-636164a67f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:09 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (9af8f4fd-c335-4ccc-adaf-c65fe830bb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:09 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-70c0839b-271b-45e6-9b82-e067a2ca453a tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:57:10 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 1073741824" returned: 0 in 0.489s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:10 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 Apr 14 03:57:10 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:10 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1" returned: 0 in 0.411s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.195s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8837f0e8-eeef-4b35-af41-43924a9dd19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed665d54-b3bf-4d15-84a8-5dd03ea9dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Creating offline snapshot 1ef09b46-3b63-43b0-8e47-7a785c7751ae of volume f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:57:10 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Volume volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 (f7ee2808-3e92-436c-808b-1ea3415ee8e1): created successfully Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed665d54-b3bf-4d15-84a8-5dd03ea9dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Flow 'volume_create_manager' (e9bd2a08-4de9-41bb-9fe4-c6d8d7656e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fc0ef0-b3fa-40dc-804b-b6cd6aa5495c]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:10 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:10 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0dc7f448-33ef-4878-a7c4-e1c557f58ef8 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created volume successfully. Apr 14 03:57:10 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:10 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:11 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:11 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae 1G Apr 14 03:57:11 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-f7ee2808-3e92-436c-808b-1ea3415ee8e1-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-f7ee2808-3e92-436c-808b-1ea3415ee8e1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-f7ee2808-3e92-436c-808b-1ea3415ee8e1" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-f7ee2808-3e92-436c-808b-1ea3415ee8e1" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8097f69-46b0-43da-8ca5-45bce7b5bbe1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:11 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 Apr 14 03:57:11 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:11 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae 1G" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:11 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:11 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:11 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:11 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:11 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1 Apr 14 03:57:11 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:12 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.442s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:12 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae is being set with open permissions: ugo+rw Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:12 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:12 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:12 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f7ee2808-3e92-436c-808b-1ea3415ee8e1" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-f7ee2808-3e92-436c-808b-1ea3415ee8e1" released by "delete_volume" :: held 0.982s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['b788bd8c-0bad-41d5-b79e-82cc70293152', '237a87f6-282d-496a-b246-cf502a793953', '9bfc9564-a762-47fa-b033-6443f8ee2103', 'fbbb296f-5a17-4b2f-8ff7-34be2aa05cf6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:12 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:12 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd7ada-a471-4072-9c6c-d8969ce790d0]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:12 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.460s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:12 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info Apr 14 03:57:12 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:12 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 Apr 14 03:57:12 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:12 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.437s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:12 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:12 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-b346a193-6aa5-44cc-aab4-3119e9faca6e tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-f7ee2808-3e92-436c-808b-1ea3415ee8e1-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:13 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:13 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info is being set with open permissions: ugo+rw Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:13 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" returned: 0 in 0.505s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:13 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info Apr 14 03:57:13 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:13 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915 Apr 14 03:57:13 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:13 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.info" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.478s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1228694600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3159815-49d3-4120-b2a4-fdeeb8d9193a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:07Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume f3159815-49d3-4120-b2a4-fdeeb8d9193a {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:13 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:13 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a 1073741824 Apr 14 03:57:13 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:13 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:13 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1a140af5-d8d0-4972-87c7-cb7d234068f8 tempest-SnapshotDependencyTests-376018297 None] Create snapshot completed successfully Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" returned: 0 in 0.450s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915" released by "delete_volume" :: held 0.977s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['feaa035d-b2a2-41cb-9825-ad5c8c9040ca', '4a55ed8f-c365-41eb-b5a2-6793ddf045e8', 'd8c592c0-0e0b-4788-bbc2-5f33c6624465', '1b437d6f-6181-48bc-a8d3-bdb3e0471e5e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:13 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:13 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:13 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Flow 'volume_create_manager' (774d5d6f-7a49-40fd-9772-3bea7d3053da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c2bc0e-37ac-4bcd-b925-5a899fa62c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c2bc0e-37ac-4bcd-b925-5a899fa62c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb8b4c5-dff4-4660-97db-87f41e04fc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2aebc6f5949a381d6e6d7617f1532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ef09b46-3b63-43b0-8e47-7a785c7751ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:14Z,use_quota=True,user_id='ed0e02ef0e714a3f9ee0a7b1d8eb48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8201815f-c357-4ca0-b0f7-df66e8e51dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8201815f-c357-4ca0-b0f7-df66e8e51dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755135c-3380-4ef2-a075-eb937246eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755135c-3380-4ef2-a075-eb937246eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eb8b4c5-dff4-4660-97db-87f41e04fc98', 'volume_name': 'volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98', 'volume_size': 1, 'snapshot_id': '1ef09b46-3b63-43b0-8e47-7a785c7751ae'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091e3acc-558b-4991-9e4b-cea3929f33f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091e3acc-558b-4991-9e4b-cea3929f33f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03d6a15-cb51-4035-b63d-46578cf19e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Volume 2eb8b4c5-dff4-4660-97db-87f41e04fc98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98', 'volume_size': 1, 'snapshot_id': '1ef09b46-3b63-43b0-8e47-7a785c7751ae'} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:14 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a 1073741824" returned: 0 in 0.594s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-2006e25b-044b-4f19-9a3d-f84f87962175 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-ccbcb0bd-50fc-4b75-b897-2f0dcda4d915-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:14 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a Apr 14 03:57:14 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:14 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.965s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-777163127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023854b-dae2-4487-94fb-c88cf4afe6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:09Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Creating volume f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:14 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ae2c99-eb5d-4eee-a50a-fe9e82e9ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc 1073741824 Apr 14 03:57:14 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bd76a3-5a9b-4494-b469-6648611890d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:14 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a (f3159815-49d3-4120-b2a4-fdeeb8d9193a): created successfully Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bd76a3-5a9b-4494-b469-6648611890d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (8345df82-3b5e-4347-a9e0-eddb88e7a06c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:14 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-001e02b1-9b7a-48a6-aa21-aa265a3201ed tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-f141da9f-bc58-4637-871b-694bdc7c2221-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-f141da9f-bc58-4637-871b-694bdc7c2221-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-f141da9f-bc58-4637-871b-694bdc7c2221" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-f141da9f-bc58-4637-871b-694bdc7c2221" acquired by "delete_volume" :: waited 0.017s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c99b03-3916-4c9e-b700-5bd6ae3cbb95]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:14 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:14 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 Apr 14 03:57:14 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:15 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc 1073741824" returned: 0 in 0.518s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:15 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:15 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:15 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:15 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221 Apr 14 03:57:15 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (e044daa2-0cbf-4eb3-bb6b-0c4e40d55409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c2c0f-9e8e-4611-a586-502cbecd0377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.513s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.492s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae-2eb8b4c5-dff4-4660-97db-87f41e04fc98" by "_create_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c2c0f-9e8e-4611-a586-502cbecd0377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581809926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43528aa-cc80-4517-8305-39f5ff3bd196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77cfdcf-b791-4aac-8498-a2ef120d04b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77cfdcf-b791-4aac-8498-a2ef120d04b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32fd85-8111-4f46-b74c-cb994e343a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b32fd85-8111-4f46-b74c-cb994e343a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43528aa-cc80-4517-8305-39f5ff3bd196', 'volume_name': 'volume-e43528aa-cc80-4517-8305-39f5ff3bd196', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49b0e57-f125-47fa-ab55-82f741d63d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49b0e57-f125-47fa-ab55-82f741d63d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9620cbb1-7b87-44e3-b1e5-5cc135503a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume e43528aa-cc80-4517-8305-39f5ff3bd196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43528aa-cc80-4517-8305-39f5ff3bd196', 'volume_size': 1} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6be7b8-a784-4672-8e2d-85d2a05a999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f023854b-dae2-4487-94fb-c88cf4afe6cc', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb33f4-c537-4c85-a7c8-f9b6dc195c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae-2eb8b4c5-dff4-4660-97db-87f41e04fc98" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Creating volume 2eb8b4c5-dff4-4660-97db-87f41e04fc98 from snapshot 1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:15 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Volume volume-f023854b-dae2-4487-94fb-c88cf4afe6cc (f023854b-dae2-4487-94fb-c88cf4afe6cc): created successfully Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb33f4-c537-4c85-a7c8-f9b6dc195c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (72848382-b495-41e9-a964-24a9ecf9baae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f141da9f-bc58-4637-871b-694bdc7c2221" returned: 0 in 0.475s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] snapshot: 1ef09b46-3b63-43b0-8e47-7a785c7751ae, volume: 2eb8b4c5-dff4-4660-97db-87f41e04fc98, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[12964272-83b0-48e1-8bef-d837b9d72b28]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:15 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-391fed64-852c-4370-b5c6-e399e839ecdf tempest-VolumeDependencyTests-2089132427 None] Created volume successfully. Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-f141da9f-bc58-4637-871b-694bdc7c2221" released by "delete_volume" :: held 1.071s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (b3e5da30-7fa1-414f-aa37-b3bd53dd8e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6c40ba-34ce-41fe-a3a8-ee9e0dce9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:15 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6c40ba-34ce-41fe-a3a8-ee9e0dce9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899678756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dffe4e-d355-4501-9ea0-83363bffcec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b525a56-2db0-447b-b102-5d1312a7492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b525a56-2db0-447b-b102-5d1312a7492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde21b19-2475-47e7-b9ed-f26b994d9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde21b19-2475-47e7-b9ed-f26b994d9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1dffe4e-d355-4501-9ea0-83363bffcec0', 'volume_name': 'volume-a1dffe4e-d355-4501-9ea0-83363bffcec0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978fc058-e4d4-45d0-a448-67d8f75f3315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978fc058-e4d4-45d0-a448-67d8f75f3315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a31c86-e467-4ee7-b37b-9f216c366757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:15 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume a1dffe4e-d355-4501-9ea0-83363bffcec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1dffe4e-d355-4501-9ea0-83363bffcec0', 'volume_size': 1} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['c78f3f80-4de4-4f06-bfd3-3708a168e719', '464ed26c-4294-4574-9198-0ab7a3afed44', '3d4c8dae-fc9f-44e4-ac46-38da875b64f3', 'f6328ae2-a2ab-47d0-b79d-0ac0768742a6'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (c9568931-fbac-42a4-98e0-2a9a14622cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:15 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07de34d-e50e-400a-af62-e9d0459917c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:16 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07de34d-e50e-400a-af62-e9d0459917c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986615134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5727e6c5-0bf0-4107-ba55-89002fa647dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22e6af8-473e-4649-9852-b5ee87bd8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22e6af8-473e-4649-9852-b5ee87bd8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00eecc-f6e7-4b6e-8f3c-3c2b1fe6a88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00eecc-f6e7-4b6e-8f3c-3c2b1fe6a88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5727e6c5-0bf0-4107-ba55-89002fa647dd', 'volume_name': 'volume-5727e6c5-0bf0-4107-ba55-89002fa647dd', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddc9a28-6a74-424c-87ae-b0a62b9c1ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddc9a28-6a74-424c-87ae-b0a62b9c1ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b27055e-9878-4205-ac2b-a24e18f38588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume 5727e6c5-0bf0-4107-ba55-89002fa647dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5727e6c5-0bf0-4107-ba55-89002fa647dd', 'volume_size': 1} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (3e9222eb-ed7d-4900-b69a-f66b337fa717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ba116-f120-4a0e-b92f-6c8c986b3983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7ba116-f120-4a0e-b92f-6c8c986b3983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-552107649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87533bf5-4726-4b59-a699-5eabb6e86cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c2c717-1b83-4a70-bc3b-d468b028f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c2c717-1b83-4a70-bc3b-d468b028f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb978899-8214-4b99-9cea-78c6bc9615a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb978899-8214-4b99-9cea-78c6bc9615a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87533bf5-4726-4b59-a699-5eabb6e86cba', 'volume_name': 'volume-87533bf5-4726-4b59-a699-5eabb6e86cba', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253779c2-d1b7-48c7-bc57-e02b5431eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253779c2-d1b7-48c7-bc57-e02b5431eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765719b7-84f9-4d88-a77d-5d5d348e0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume 87533bf5-4726-4b59-a699-5eabb6e86cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87533bf5-4726-4b59-a699-5eabb6e86cba', 'volume_size': 1} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:16 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.631s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (f307963d-6e67-4afd-bade-771d3d6b2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70238fb2-873b-4e1a-a8c5-472afc6c5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[922be0b3-d6f8-475e-95dd-e65638d040f2]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70238fb2-873b-4e1a-a8c5-472afc6c5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-290315449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12f964c-fa31-4d64-a840-bff0118220a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2bf11e22e548e8aaced8560eb6cc06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f023854b-dae2-4487-94fb-c88cf4afe6cc,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='6daf60715e95414584f5d8bd3dbb3fa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011ceca5-d2bd-4255-b3ad-4ef38f00c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011ceca5-d2bd-4255-b3ad-4ef38f00c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced80013-8a12-4542-8969-03dde16d6d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (0717b037-9b63-48c3-b040-4b8e96e66bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:16 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560dce57-10fa-403d-963b-8a777ff9c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:16 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560dce57-10fa-403d-963b-8a777ff9c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932723397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bddc8f-4b4b-4b99-9b8d-8dab8793f85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cebaa1-21cf-4c02-bd9d-f63473429060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cebaa1-21cf-4c02-bd9d-f63473429060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb066c-1c57-4e53-9543-252cf817256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb066c-1c57-4e53-9543-252cf817256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04bddc8f-4b4b-4b99-9b8d-8dab8793f85f', 'volume_name': 'volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401bf624-fdba-49a7-b6c6-122080328fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401bf624-fdba-49a7-b6c6-122080328fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6410ebfb-2b67-4259-9a44-a71082026b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume 04bddc8f-4b4b-4b99-9b8d-8dab8793f85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f', 'volume_size': 1} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced80013-8a12-4542-8969-03dde16d6d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e12f964c-fa31-4d64-a840-bff0118220a2', 'volume_name': 'volume-e12f964c-fa31-4d64-a840-bff0118220a2', 'volume_size': 1, 'source_volid': 'f023854b-dae2-4487-94fb-c88cf4afe6cc', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdc80b3-4ba8-4e22-aa95-1edbd929dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdc80b3-4ba8-4e22-aa95-1edbd929dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39408665-c398-46cc-b8f8-acc89a389185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:16 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Volume e12f964c-fa31-4d64-a840-bff0118220a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e12f964c-fa31-4d64-a840-bff0118220a2', 'volume_size': 1, 'source_volid': 'f023854b-dae2-4487-94fb-c88cf4afe6cc', 'source_volstatus': 'available'} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.614s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:16 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-a32ea573-2653-48db-9d5c-efce7bd47dba tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-f141da9f-bc58-4637-871b-694bdc7c2221-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-72423227-f95f-4545-98f1-4ef9bf4d752d-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-72423227-f95f-4545-98f1-4ef9bf4d752d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-72423227-f95f-4545-98f1-4ef9bf4d752d" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-72423227-f95f-4545-98f1-4ef9bf4d752d" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bf1bd2-f2f5-45b7-8cda-b3b9ef2f1c41]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:16 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.497s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:57:16 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:16 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 Apr 14 03:57:16 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:16 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d Apr 14 03:57:16 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:17 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:17 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:17 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d Apr 14 03:57:17 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:18 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-72423227-f95f-4545-98f1-4ef9bf4d752d" returned: 0 in 1.022s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-72423227-f95f-4545-98f1-4ef9bf4d752d" released by "delete_volume" :: held 1.539s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['578b2c36-3576-4bc1-92b6-dd437e0cf91b', 'dd82ec72-0eea-480c-92ed-993939bed606', '9becf90a-7ac1-4c3b-9ef8-f724e1ba868d', '6c4aedb4-7e4c-4615-94ed-a848cf71a599'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:18 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:18 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:18 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98" returned: 0 in 2.023s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3132341-0f99-419d-b724-610ce8f6a3a6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:18 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:19 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:19 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9416f5e2-c152-4d60-b6b5-48838de601a1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:19 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a Apr 14 03:57:19 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:19 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.633s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:19 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-659ad224-4c2b-4a81-b2c4-83fdfa258ed2 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-72423227-f95f-4545-98f1-4ef9bf4d752d-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:19 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.608s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:57:19 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Converted 1024.00 MB image at 505.88 MB/s Apr 14 03:57:19 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 is being set with open permissions: ugo+rw Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:19 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 Apr 14 03:57:19 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:19 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" returned: 0 in 0.510s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:19 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a Apr 14 03:57:19 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:19 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:19 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98" returned: 0 in 0.414s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" released by "_copy_volume_from_snapshot" :: held 4.294s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae-2eb8b4c5-dff4-4660-97db-87f41e04fc98" released by "_create_volume_from_snapshot" :: held 4.345s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.411s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.383s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581809926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43528aa-cc80-4517-8305-39f5ff3bd196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume e43528aa-cc80-4517-8305-39f5ff3bd196 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:20 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 1073741824 Apr 14 03:57:20 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03d6a15-cb51-4035-b63d-46578cf19e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98', 'volume_size': 1, 'snapshot_id': '1ef09b46-3b63-43b0-8e47-7a785c7751ae'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c5a50-107b-4e83-adaf-c93ff2a230b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:20 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Volume volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 (2eb8b4c5-dff4-4660-97db-87f41e04fc98): created successfully Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c5a50-107b-4e83-adaf-c93ff2a230b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Flow 'volume_create_manager' (774d5d6f-7a49-40fd-9772-3bea7d3053da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-78cf3c16-665e-4aba-a0ce-7b1eff1ca0d8 tempest-SnapshotDependencyTests-376018297 None] Created volume successfully. Apr 14 03:57:20 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" returned: 0 in 0.400s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a" released by "delete_volume" :: held 0.929s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['c34822d9-a720-42e9-a4a8-e12e3ff169d7', 'b7f67539-fdb5-4035-8c4d-1ee2353e7e2c', 'bb880734-69e7-4883-a197-f215f7a8094e', '3f4fa694-aec1-48c5-bacc-6db48e2b8fc3'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:20 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-c633c4cd-4e07-4596-879d-0d77250e353e-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-c633c4cd-4e07-4596-879d-0d77250e353e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-c633c4cd-4e07-4596-879d-0d77250e353e" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-c633c4cd-4e07-4596-879d-0d77250e353e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleting offline snapshot c633c4cd-4e07-4596-879d-0d77250e353e of volume 5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] snapshot_file for this snap is: volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec3fc4-a5fd-4093-98d6-4ef4455eb2c9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e Apr 14 03:57:20 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-1ef09b46-3b63-43b0-8e47-7a785c7751ae-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 1073741824" returned: 0 in 0.560s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-1ef09b46-3b63-43b0-8e47-7a785c7751ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Deleting offline snapshot 1ef09b46-3b63-43b0-8e47-7a785c7751ae of volume f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] snapshot_file for this snap is: volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b21c5-b1d2-4c51-ad40-4e3442a63d58]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 Apr 14 03:57:20 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:20 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.516s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:20 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-81b9ab9d-42a8-4df0-8740-91d2be50bec7 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-21bd278f-8107-44e1-bc5b-f10a5f5e0b6a-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:20 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:20 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:20 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c6da4af-5005-409a-a44a-f39727bb935e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b366d-e6db-413f-ad10-2f6a26f731f6]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:20 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:20 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e Apr 14 03:57:20 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196" returned: 0 in 0.429s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.170s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899678756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dffe4e-d355-4501-9ea0-83363bffcec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume a1dffe4e-d355-4501-9ea0-83363bffcec0 {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:21 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9620cbb1-7b87-44e3-b1e5-5cc135503a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43528aa-cc80-4517-8305-39f5ff3bd196', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42517580-14b5-4620-ba14-68b50261a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:21 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 1073741824 Apr 14 03:57:21 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-e43528aa-cc80-4517-8305-39f5ff3bd196 (e43528aa-cc80-4517-8305-39f5ff3bd196): created successfully Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42517580-14b5-4620-ba14-68b50261a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (e044daa2-0cbf-4eb3-bb6b-0c4e40d55409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:21 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-1e285573-47ee-43ab-93d4-f06f8d9713ad tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:21 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.526s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c963a-513b-4e7b-a213-9867169f42fb]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:21 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e" returned: 0 in 0.488s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e Apr 14 03:57:21 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 1073741824" returned: 0 in 0.499s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 Apr 14 03:57:21 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.535s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:21 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:21 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e" returned: 0 in 0.516s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:21 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:21 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e Apr 14 03:57:21 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:22 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.994s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986615134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5727e6c5-0bf0-4107-ba55-89002fa647dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume 5727e6c5-0bf0-4107-ba55-89002fa647dd {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a31c86-e467-4ee7-b37b-9f216c366757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1dffe4e-d355-4501-9ea0-83363bffcec0', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4774d8a3-1f8a-4012-9ce8-6d2b8c3c1523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:22 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd 1073741824 Apr 14 03:57:22 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 (a1dffe4e-d355-4501-9ea0-83363bffcec0): created successfully Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4774d8a3-1f8a-4012-9ce8-6d2b8c3c1523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (b3e5da30-7fa1-414f-aa37-b3bd53dd8e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-59c8f952-e697-4e93-bfd5-49bf90b8811c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:22 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.487s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:22 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae Apr 14 03:57:22 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:22 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e.c633c4cd-4e07-4596-879d-0d77250e353e" returned: 0 in 0.444s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-c633c4cd-4e07-4596-879d-0d77250e353e" released by "_delete_snapshot" :: held 2.045s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" released by "delete_snapshot" :: held 2.059s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['02877064-71a2-4467-9368-02e4708f8cfa', '4971dbe4-1ded-4cb5-831a-79862481b00f', '3a3309fc-9b6b-4666-8dc9-7b40bf1c0824', '1d11a17d-bb26-4b75-b886-298b776d5429'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Delete snapshot completed successfully. Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-7f65f368-d5bc-44f5-9c19-f2f224392ca6 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-c633c4cd-4e07-4596-879d-0d77250e353e-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd 1073741824" returned: 0 in 0.508s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:22 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd Apr 14 03:57:22 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:22 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c.1ef09b46-3b63-43b0-8e47-7a785c7751ae" returned: 0 in 0.439s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-1ef09b46-3b63-43b0-8e47-7a785c7751ae" released by "_delete_snapshot" :: held 2.048s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" released by "delete_snapshot" :: held 2.062s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Created reservations ['695508fe-a768-45dd-819b-b8f105a61afc', '2d9e4bf6-f36d-40fd-845c-59fffa6039e0', 'f0d7695a-55b5-450b-90a2-0386de162b12', '4207beb6-2db9-4889-bad7-508b4865d6f7'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Delete snapshot completed successfully. Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-922e8ae8-9218-47b6-a2fa-36687f698717 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-1ef09b46-3b63-43b0-8e47-7a785c7751ae-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:22 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd" returned: 0 in 0.421s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.638s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-552107649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87533bf5-4726-4b59-a699-5eabb6e86cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume 87533bf5-4726-4b59-a699-5eabb6e86cba {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:22 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:22 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b27055e-9878-4205-ac2b-a24e18f38588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5727e6c5-0bf0-4107-ba55-89002fa647dd', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82296e77-68fa-419c-8645-d063bd6b1121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:23 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba 1073741824 Apr 14 03:57:23 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:23 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-5727e6c5-0bf0-4107-ba55-89002fa647dd (5727e6c5-0bf0-4107-ba55-89002fa647dd): created successfully Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82296e77-68fa-419c-8645-d063bd6b1121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (c9568931-fbac-42a4-98e0-2a9a14622cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:23 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-a1e70778-875f-4979-b046-fc6eae5003ee tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-5c6da4af-5005-409a-a44a-f39727bb935e-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-5c6da4af-5005-409a-a44a-f39727bb935e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a534be-9d4d-4827-a8ea-6ebb72ffb44a]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:23 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba 1073741824" returned: 0 in 0.501s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:23 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e Apr 14 03:57:23 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:23 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba Apr 14 03:57:23 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-f903a4a0-7391-4fd7-b44f-0e182de23b1c-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-f903a4a0-7391-4fd7-b44f-0e182de23b1c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" acquired by "delete_volume" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5015b-8e60-4a2e-bca7-a772ab729968]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:23 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:23 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:23 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:23 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba" returned: 0 in 0.471s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:23 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.453s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932723397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bddc8f-4b4b-4b99-9b8d-8dab8793f85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ee8cc972e480c9eb7d98652f75983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:16Z,use_quota=True,user_id='f76cbfd08bef47479a7e193ecdb5ffd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Creating volume 04bddc8f-4b4b-4b99-9b8d-8dab8793f85f {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:24 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e" returned: 0 in 0.554s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f 1073741824 Apr 14 03:57:24 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765719b7-84f9-4d88-a77d-5d5d348e0d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87533bf5-4726-4b59-a699-5eabb6e86cba', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbc6760-24fe-4357-8792-02a33882d925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:24 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e Apr 14 03:57:24 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-87533bf5-4726-4b59-a699-5eabb6e86cba (87533bf5-4726-4b59-a699-5eabb6e86cba): created successfully Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbc6760-24fe-4357-8792-02a33882d925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (3e9222eb-ed7d-4900-b69a-f66b337fa717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:24 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-37e2b27a-a57b-412c-b863-69efb72581d2 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:24 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.477s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c Apr 14 03:57:24 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5c6da4af-5005-409a-a44a-f39727bb935e" returned: 0 in 0.443s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f 1073741824" returned: 0 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-quobyte-5c6da4af-5005-409a-a44a-f39727bb935e" released by "delete_volume" :: held 1.048s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f Apr 14 03:57:24 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Created reservations ['0944b9c5-c268-4308-a26f-32842f3b6e1a', '16f2d793-efe3-4bad-a793-d769b4ff087e', '428a966b-15a3-4aed-b02c-1fc97593829d', '39960d60-481a-4c86-a2c8-b7b056ce65dd'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:24 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f903a4a0-7391-4fd7-b44f-0e182de23b1c" returned: 0 in 0.477s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-f903a4a0-7391-4fd7-b44f-0e182de23b1c" released by "delete_volume" :: held 0.989s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Created reservations ['65dcb7b6-ba9e-46f9-ac94-9464658de539', '9bab2b23-10d5-479c-ac45-2c236b091a70', 'b748bb02-e2b6-41ae-9c77-d19fa1076f80', 'e8869696-fa77-4131-8790-00182dcdb4b1'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-2eb8b4c5-dff4-4660-97db-87f41e04fc98-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:24 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:24 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-2eb8b4c5-dff4-4660-97db-87f41e04fc98-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" acquired by "delete_volume" :: waited 0.006s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b4d5c5-ea5d-495c-8812-362ee64466d8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:24 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 Apr 14 03:57:24 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:24 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" returned: 0 in 0.490s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:24 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.431s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:25 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Cloning volume f023854b-dae2-4487-94fb-c88cf4afe6cc to volume e12f964c-fa31-4d64-a840-bff0118220a2 Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6410ebfb-2b67-4259-9a44-a71082026b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076dbdd2-dc23-4be3-9f32-b367062f672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:25 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Creating offline snapshot 927c2bf8-2241-49c4-9704-37230e337078 of volume f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.474s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cccaaba-5d43-4320-8337-e5096e27e744]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:25 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Volume volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f (04bddc8f-4b4b-4b99-9b8d-8dab8793f85f): created successfully Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076dbdd2-dc23-4be3-9f32-b367062f672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Flow 'volume_create_manager' (0717b037-9b63-48c3-b040-4b8e96e66bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Deleted volume successfully. Apr 14 03:57:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-fc5bc778-ea73-4436-902d-9c71dfe980db tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created volume successfully. Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c8c6bf04-281b-4a22-95a7-7ed3d86320e3 tempest-CreateVolumesFromSnapshotTest-2093028053 None] Lock "cinder-5c6da4af-5005-409a-a44a-f39727bb935e-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:25 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:25 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25874fb-3c40-41f7-9ea6-f105d454bff3]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:25 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f Apr 14 03:57:25 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:25 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.497s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:25 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Deleted volume successfully. Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-d2e1d8da-1061-4aa7-a7ad-6142da91aefc tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-f903a4a0-7391-4fd7-b44f-0e182de23b1c-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:25 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98" returned: 0 in 0.529s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:25 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98 Apr 14 03:57:25 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:25 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.597s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:25 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" returned: 0 in 0.494s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:25 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 1G Apr 14 03:57:25 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:25 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f Apr 14 03:57:25 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:25 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-2eb8b4c5-dff4-4660-97db-87f41e04fc98" returned: 0 in 0.473s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-quobyte-2eb8b4c5-dff4-4660-97db-87f41e04fc98" released by "delete_volume" :: held 1.029s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:25 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Created reservations ['9a690c46-7b25-4330-994b-1b5bfdb79fa3', '6cd54e43-32e6-4ce2-9ae3-d3bc33e3d756', 'ebd9ea50-3bc8-48c5-ae69-59128a65d20d', 'c1e71380-eef3-47cc-a67d-43a2e3f4f6d9'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:26 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:26 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:26 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" returned: 0 in 0.554s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f" released by "delete_volume" :: held 1.071s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:26 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 1G" returned: 0 in 0.638s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023854b-dae2-4487-94fb-c88cf4afe6cc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:26 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023854b-dae2-4487-94fb-c88cf4afe6cc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:26 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['84bf2c97-9f6e-4471-b49a-e23a89f5cf75', '0f48ee5e-b7ed-4178-9d00-c4262affdc08', '552ca462-3fb3-4d6a-9c44-ff16c2f288a1', 'cd3fdb29-2e08-4d7d-8eed-104d180ee1e3'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:26 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:26 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:26 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.514s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Deleted volume successfully. Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-07ebaeeb-6b6e-4567-8770-c1134f34d348 tempest-SnapshotDependencyTests-376018297 None] Lock "cinder-2eb8b4c5-dff4-4660-97db-87f41e04fc98-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:26 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023854b-dae2-4487-94fb-c88cf4afe6cc -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.556s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:26 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 is being set with open permissions: ugo+rw Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:26 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:26 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:26 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.525s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:26 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:26 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-9f0d5930-a3f3-4f41-96d9-85ad9cb7bd1d tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-04bddc8f-4b4b-4b99-9b8d-8dab8793f85f-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:27 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Flow 'volume_create_manager' (0cdd2f5f-144a-4776-a85f-27c813eb7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01165317-863f-4372-a75d-049c852332cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-87533bf5-4726-4b59-a699-5eabb6e86cba-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:27 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info Apr 14 03:57:27 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01165317-863f-4372-a75d-049c852332cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0599dc-052b-4fe5-b88b-294ff42e9c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff00ad2f39d46eab4be2909371a42b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:27Z,use_quota=True,user_id='659ef48dd35e4973b87ecce1fcbeaa15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40177693-90ce-4539-ad99-3cee37d4eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40177693-90ce-4539-ad99-3cee37d4eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33442893-f971-435e-9b45-4ff7c4a2b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33442893-f971-435e-9b45-4ff7c4a2b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0599dc-052b-4fe5-b88b-294ff42e9c0c', 'volume_name': 'volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30a6745-855a-46c0-b161-eddd5cb05f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30a6745-855a-46c0-b161-eddd5cb05f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e5aab9-7357-4860-9528-ae5319a45eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:27 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Volume af0599dc-052b-4fe5-b88b-294ff42e9c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c', 'volume_size': 1} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-87533bf5-4726-4b59-a699-5eabb6e86cba-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-87533bf5-4726-4b59-a699-5eabb6e86cba" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-87533bf5-4726-4b59-a699-5eabb6e86cba" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f924610-cb82-4cec-97ef-26d52e4863bf]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:27 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba Apr 14 03:57:27 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:27 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info" returned: 0 in 0.485s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:27 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info is being set with open permissions: ugo+rw Apr 14 03:57:27 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:27 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info Apr 14 03:57:27 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:28 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba" returned: 0 in 0.570s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:28 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba Apr 14 03:57:28 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:28 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.info" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" by "_copy_volume_from_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] snapshot: 927c2bf8-2241-49c4-9704-37230e337078, volume: e12f964c-fa31-4d64-a840-bff0118220a2, {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3ab1e-9cfe-4a22-860b-5cc53ec9d11f]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:28 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:28 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:28 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-87533bf5-4726-4b59-a699-5eabb6e86cba" returned: 0 in 0.461s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-87533bf5-4726-4b59-a699-5eabb6e86cba" released by "delete_volume" :: held 1.054s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['5327cf52-93c7-4dba-8c06-e68987d98139', '879a1727-e4dc-4b13-bab2-6f7676503bd9', 'e6e7dc89-b20b-407c-b37a-067ffef71bf7', 'afaf72c0-4552-4e68-a3cf-5345ff70897e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:28 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:28 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:28 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.524s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023854b-dae2-4487-94fb-c88cf4afe6cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Creating direct copy from snapshot {{(pid=82370) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330583b-a556-4f3d-b978-fd6412629e99]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:28 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:28 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:28 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:29 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.489s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:29 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e224ef74-afa5-411f-8b69-0f5235fc3529 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-87533bf5-4726-4b59-a699-5eabb6e86cba-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:29 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.555s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.utils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Path /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 not found in is_blk_device check {{(pid=82370) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:29 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 Apr 14 03:57:29 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-5727e6c5-0bf0-4107-ba55-89002fa647dd-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-5727e6c5-0bf0-4107-ba55-89002fa647dd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-5727e6c5-0bf0-4107-ba55-89002fa647dd" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-5727e6c5-0bf0-4107-ba55-89002fa647dd" acquired by "delete_volume" :: waited 0.015s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[431cbbed-0b36-4aeb-99da-51e88cd5e4ce]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:29 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:29 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd Apr 14 03:57:29 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:30 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd" returned: 0 in 1.058s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:30 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:30 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd Apr 14 03:57:30 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:31 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2" returned: 0 in 2.196s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff2e69-b334-4e96-a476-3b5dfe8e8087]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:31 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:31 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:31 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-5727e6c5-0bf0-4107-ba55-89002fa647dd" returned: 0 in 1.198s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-5727e6c5-0bf0-4107-ba55-89002fa647dd" released by "delete_volume" :: held 2.287s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['77b3a693-12dd-44de-bc18-b8852650fcdb', 'e15512b8-9448-4693-a8c6-d63e18cbc156', 'cb931dae-566a-4d5a-81af-e0aa82f8161a', 'e53c9839-78db-4d9b-a676-2c0db517430d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:31 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:31 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:32 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:32 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.673s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.image.image_utils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Image conversion details: src /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 {{(pid=82370) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:57:32 devstack cinder-volume[82370]: INFO cinder.image.image_utils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Converted 1024.00 MB image at 466.06 MB/s Apr 14 03:57:32 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 is being set with open permissions: ugo+rw Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:32 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 Apr 14 03:57:32 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:32 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.479s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:32 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-5dc0c3bf-50d5-4572-9385-284ef28b252c tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-5727e6c5-0bf0-4107-ba55-89002fa647dd-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:32 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-a1dffe4e-d355-4501-9ea0-83363bffcec0-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2" returned: 0 in 0.511s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-a1dffe4e-d355-4501-9ea0-83363bffcec0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" released by "_copy_volume_from_snapshot" :: held 4.511s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-927c2bf8-2241-49c4-9704-37230e337078" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-a1dffe4e-d355-4501-9ea0-83363bffcec0" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-927c2bf8-2241-49c4-9704-37230e337078" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Deleting offline snapshot 927c2bf8-2241-49c4-9704-37230e337078 of volume f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] snapshot_file for this snap is: volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9612ee-e7c1-4789-960f-cf3ff2727f72]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-a1dffe4e-d355-4501-9ea0-83363bffcec0" acquired by "delete_volume" :: waited 0.020s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[03933e29-2846-40e2-926a-023f48f0b8f9]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:32 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:33 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:33 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:33 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 Apr 14 03:57:33 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:33 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.548s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023854b-dae2-4487-94fb-c88cf4afe6cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:33 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0" returned: 0 in 0.546s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6905c75-d846-4aa9-8033-c888a8ce0acc]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:33 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:33 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0 Apr 14 03:57:33 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:33 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:33 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:34 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-a1dffe4e-d355-4501-9ea0-83363bffcec0" returned: 0 in 0.503s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-a1dffe4e-d355-4501-9ea0-83363bffcec0" released by "delete_volume" :: held 1.084s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['8cf2abba-0386-4545-85ef-bf0d5cb565e6', '041373bf-5229-49da-8d0e-58a7ee302760', 'ba7dbf78-4c45-4a25-997d-25834ffa5f97', '4ddced4b-20ff-44f7-b97e-e9f5f7d2eada'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:34 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.557s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:34 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:34 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:34 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:34 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:34 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:34 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-4b0a33fb-fe63-486b-bec7-6fa43542a621 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-a1dffe4e-d355-4501-9ea0-83363bffcec0-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:34 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.533s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:34 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:34 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078 Apr 14 03:57:34 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:35 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc.927c2bf8-2241-49c4-9704-37230e337078" returned: 0 in 0.415s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-927c2bf8-2241-49c4-9704-37230e337078" released by "_delete_snapshot" :: held 2.125s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.075s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.609s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0599dc-052b-4fe5-b88b-294ff42e9c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff00ad2f39d46eab4be2909371a42b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:27Z,use_quota=True,user_id='659ef48dd35e4973b87ecce1fcbeaa15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Creating volume af0599dc-052b-4fe5-b88b-294ff42e9c0c {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:35 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-e43528aa-cc80-4517-8305-39f5ff3bd196-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:35 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c 1073741824 Apr 14 03:57:35 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39408665-c398-46cc-b8f8-acc89a389185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12f964c-fa31-4d64-a840-bff0118220a2', 'volume_size': 1, 'source_volid': 'f023854b-dae2-4487-94fb-c88cf4afe6cc', 'source_volstatus': 'available'}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46b33bd-13bf-410c-bc47-5835ef52bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-e43528aa-cc80-4517-8305-39f5ff3bd196-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:35 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Volume volume-e12f964c-fa31-4d64-a840-bff0118220a2 (e12f964c-fa31-4d64-a840-bff0118220a2): created successfully Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46b33bd-13bf-410c-bc47-5835ef52bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Flow 'volume_create_manager' (f307963d-6e67-4afd-bade-771d3d6b2113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:35 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-461c4a14-ca7a-4b24-a55e-207161ad1478 tempest-VolumeDependencyTests-2089132427 None] Created volume successfully. Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-e43528aa-cc80-4517-8305-39f5ff3bd196" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-e43528aa-cc80-4517-8305-39f5ff3bd196" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f44bf-5ef4-4636-a1e0-3602780dc1ae]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:35 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 Apr 14 03:57:35 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-f023854b-dae2-4487-94fb-c88cf4afe6cc-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-f023854b-dae2-4487-94fb-c88cf4afe6cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-f023854b-dae2-4487-94fb-c88cf4afe6cc" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-f023854b-dae2-4487-94fb-c88cf4afe6cc" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f33ccf7-30d4-4f78-b467-2235aa1ed4fd]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:35 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c 1073741824" returned: 0 in 0.558s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:35 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196" returned: 0 in 0.495s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:35 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:35 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:35 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:35 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c Apr 14 03:57:35 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:35 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196 Apr 14 03:57:35 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:36 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.469s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:36 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc Apr 14 03:57:36 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:36 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:36 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e43528aa-cc80-4517-8305-39f5ff3bd196" returned: 0 in 0.438s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c" returned: 0 in 0.464s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=181,cinder:UPDATE=260,cinder:INSERT=60,cinder:DELETE=23 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e5aab9-7357-4860-9528-ae5319a45eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ef3534-85d1-4570-9a3f-c18a3fa0417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-e43528aa-cc80-4517-8305-39f5ff3bd196" released by "delete_volume" :: held 0.977s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:36 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Volume volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c (af0599dc-052b-4fe5-b88b-294ff42e9c0c): created successfully Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ef3534-85d1-4570-9a3f-c18a3fa0417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Flow 'volume_create_manager' (0cdd2f5f-144a-4776-a85f-27c813eb7b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['01ed6304-f939-4ab0-b4ae-a3c5fe3d51de', '616bdd8f-a705-4213-98e9-46cb707e3f40', 'e81016a3-f28a-4f3e-ad50-9b707cbb41d2', 'b6a36d5d-bed4-4bbe-8633-e33eeaccd7f1'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-6ca073d9-f2fd-44e2-8a82-69916cdfd647 tempest-CinderUnicodeTest-2049066884 None] Created volume successfully. Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:36 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:36 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:36 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f023854b-dae2-4487-94fb-c88cf4afe6cc" returned: 0 in 0.416s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-f023854b-dae2-4487-94fb-c88cf4afe6cc" released by "delete_volume" :: held 0.915s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Created reservations ['d55f5c19-de96-42c8-91f5-95b103255526', '90e133ef-1ccd-4043-9b27-0187866ac348', '31557c33-6340-470d-9dd3-13f6dd038910', '26a21dc5-4158-4c09-9e72-51b1b0672d8d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:36 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:36 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:36 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-e12f964c-fa31-4d64-a840-bff0118220a2-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:36 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-e12f964c-fa31-4d64-a840-bff0118220a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-bc6deae6-37cd-4384-afb3-77a698feb8d8 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-e43528aa-cc80-4517-8305-39f5ff3bd196-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" acquired by "delete_volume" :: waited 0.009s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfce8af-cfc7-485b-a5ec-a10ab079e7f8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:36 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:36 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 Apr 14 03:57:36 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.428s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:37 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Deleted volume successfully. Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-0c659e00-7c4e-4366-a723-2b4ffd4ce335 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-f023854b-dae2-4487-94fb-c88cf4afe6cc-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:37 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2" returned: 0 in 0.494s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2 Apr 14 03:57:37 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.flows.manager.create_volume [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82370) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Flow 'volume_create_manager' (004a2169-c6c6-4a58-9e56-3a66fb28c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f923cf98-b69e-4845-8b64-ebd754e22e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-f3159815-49d3-4120-b2a4-fdeeb8d9193a-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f923cf98-b69e-4845-8b64-ebd754e22e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-378041600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff00ad2f39d46eab4be2909371a42b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:37Z,use_quota=True,user_id='659ef48dd35e4973b87ecce1fcbeaa15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236211d-2c5d-428d-bf54-2ced1ed7ead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236211d-2c5d-428d-bf54-2ced1ed7ead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a214c119-1870-46f5-979e-46864c534ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a214c119-1870-46f5-979e-46864c534ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb', 'volume_name': 'volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cde6fa-791f-4042-94e3-f0faf94a1fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cde6fa-791f-4042-94e3-f0faf94a1fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae664b36-ad4d-4aec-a354-540d993bfe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:37 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Volume 1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb', 'volume_size': 1} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:57:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-378041600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ff00ad2f39d46eab4be2909371a42b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:57:37Z,use_quota=True,user_id='659ef48dd35e4973b87ecce1fcbeaa15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dc580a-ea26-4744-98a7-e7aac4a47b99),volume_type_id=f5dc580a-ea26-4744-98a7-e7aac4a47b99)}" {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Creating volume 1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Selected osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 as target Quobyte volume. {{(pid=82370) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:57:37 devstack cinder-volume[82370]: INFO cinder.volume.drivers.remotefs [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] casted to osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2 Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb 1073741824 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-f3159815-49d3-4120-b2a4-fdeeb8d9193a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:37 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb 1073741824 Apr 14 03:57:37 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "cinder-quobyte-f3159815-49d3-4120-b2a4-fdeeb8d9193a" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-f3159815-49d3-4120-b2a4-fdeeb8d9193a" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe99035-6062-4a21-8765-ff8613e509a1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a Apr 14 03:57:37 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-e12f964c-fa31-4d64-a840-bff0118220a2" returned: 0 in 0.423s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-e12f964c-fa31-4d64-a840-bff0118220a2" released by "delete_volume" :: held 0.939s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Created reservations ['cde75b93-b804-4305-a2d0-d161b9aa97e2', 'e845f2db-7aac-4657-8e2f-de6d0270db59', '4bd37c9a-ce68-42cf-b3a5-56d6d8ed4fdf', '7bd44d8d-cb25-456f-a1ab-10728f8de0c5'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:37 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-0caec173-b136-43f7-84c3-bbefa703d2ec-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-0caec173-b136-43f7-84c3-bbefa703d2ec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:37 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb 1073741824" returned: 0 in 0.549s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" acquired by "delete_volume" :: waited 0.010s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f070b5-a0be-4203-8ea2-0107c4df9649]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb Apr 14 03:57:37 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a" returned: 0 in 0.560s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:37 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:37 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a Apr 14 03:57:37 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:38 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec Apr 14 03:57:38 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:38 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.430s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Deleted volume successfully. Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-64530edd-a3f2-4b8d-9cea-7b8e670af9ec tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-e12f964c-fa31-4d64-a840-bff0118220a2-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:38 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" returned: 0 in 0.448s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'} {{(pid=82370) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae664b36-ad4d-4aec-a354-540d993bfe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb', 'volume_size': 1}' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b96ab-d5a3-4390-86f9-9441ab1d551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:57:38 devstack cinder-volume[82370]: INFO cinder.volume.flows.manager.create_volume [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Volume volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb (1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb): created successfully Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b96ab-d5a3-4390-86f9-9441ab1d551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82370) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Flow 'volume_create_manager' (004a2169-c6c6-4a58-9e56-3a66fb28c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82370) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:UPDATE=265,cinder:SELECT=193,cinder:DELETE=24,cinder:INSERT=62 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:57:38 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-f3159815-49d3-4120-b2a4-fdeeb8d9193a" returned: 0 in 0.459s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-de518879-7943-433f-ab89-9cc4f9d529b0 tempest-CinderUnicodeTest-2049066884 None] Created volume successfully. Apr 14 03:57:38 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec" returned: 0 in 0.484s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-quobyte-f3159815-49d3-4120-b2a4-fdeeb8d9193a" released by "delete_volume" :: held 1.045s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:38 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec Apr 14 03:57:38 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Created reservations ['c1f3031c-e159-4f61-a28f-6140e50dc8b4', 'e607887e-7bf5-4416-9db4-fd7614722e0b', '3eb051db-838e-41dc-80d2-bec570fbd3ee', '532ef371-05e1-4e7e-a5f8-e36da988c988'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:38 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:38 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:38 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-0caec173-b136-43f7-84c3-bbefa703d2ec" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-quobyte-0caec173-b136-43f7-84c3-bbefa703d2ec" released by "delete_volume" :: held 0.928s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Created reservations ['833be070-ce50-4890-8d09-a7c30606e51d', '4bbd2d98-14a6-468e-9c4a-1aac4aeaa299', '31481224-5485-4ea1-808a-31a66ae6e8ac', 'c3ac6e8d-238c-412d-8152-5e1ec9a5bbb1'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:38 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:38 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Deleted volume successfully. Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:38 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-35b9ed57-a0de-4ff3-8aa0-186e6f10f2c6 tempest-CreateVolumesFromSourceVolumeTest-1756766264 None] Lock "cinder-f3159815-49d3-4120-b2a4-fdeeb8d9193a-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:38 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:38 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:39 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.472s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:39 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Deleted volume successfully. Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c46be195-e780-4312-9bfb-12e86e61dc83 tempest-VolumeDependencyTests-2089132427 None] Lock "cinder-0caec173-b136-43f7-84c3-bbefa703d2ec-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Creating offline snapshot fee4c132-a4f9-43d6-b777-efae2032a6b3 of volume 1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[914d000e-93e0-4358-a760-16ab27a07fb8]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:39 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:39 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb Apr 14 03:57:39 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:40 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" returned: 0 in 0.543s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 1G {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:40 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 1G Apr 14 03:57:40 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:40 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 1G" returned: 0 in 0.552s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:40 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:40 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 Apr 14 03:57:40 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:41 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb -F qcow2 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3" returned: 0 in 0.426s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:41 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 is being set with open permissions: ugo+rw Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:41 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 Apr 14 03:57:41 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:41 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3" returned: 0 in 0.409s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:41 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info Apr 14 03:57:41 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:41 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info" returned: 0 in 0.436s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:41 devstack cinder-volume[82370]: WARNING cinder.volume.drivers.remotefs [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info is being set with open permissions: ugo+rw Apr 14 03:57:41 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:42 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info Apr 14 03:57:42 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:42 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.info" returned: 0 in 0.403s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:42 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-f53d0b10-97f2-40ba-b8e4-b72beb179e6b tempest-CinderUnicodeTest-2049066884 None] Create snapshot completed successfully Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-fee4c132-a4f9-43d6-b777-efae2032a6b3-delete_snapshot" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-fee4c132-a4f9-43d6-b777-efae2032a6b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" by "delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-quobyte-fee4c132-a4f9-43d6-b777-efae2032a6b3" by "_delete_snapshot" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-fee4c132-a4f9-43d6-b777-efae2032a6b3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Deleting offline snapshot fee4c132-a4f9-43d6-b777-efae2032a6b3 of volume 1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] snapshot_file for this snap is: volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabac7e-56c8-4c63-b74f-be8091d79ac1]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:42 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:42 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 Apr 14 03:57:42 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:43 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3" returned: 0 in 0.509s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.remotefs [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82370) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae6f25-6b50-4372-aaee-fef48ac257e7]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:43 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb Apr 14 03:57:43 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:43 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" returned: 0 in 0.476s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:43 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:43 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 Apr 14 03:57:43 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:44 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3" returned: 0 in 0.468s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:44 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3 Apr 14 03:57:44 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:44 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb.fee4c132-a4f9-43d6-b777-efae2032a6b3" returned: 0 in 0.420s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-fee4c132-a4f9-43d6-b777-efae2032a6b3" released by "_delete_snapshot" :: held 1.933s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" released by "delete_snapshot" :: held 1.944s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Created reservations ['f350eab9-355e-446d-ae0e-b36cdbf8fdb7', '0addc4ae-d733-4bba-8e9d-abcfd4b4a4e0', '2030484a-95da-4dc0-9e9f-2a20b341ebb1', 'f2b89e47-315f-4d0d-9ea5-7369bb2ee031'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:44 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Delete snapshot completed successfully. Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-e3a08733-e1ac-4075-837a-98c75928eda8 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-fee4c132-a4f9-43d6-b777-efae2032a6b3-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" acquired by "delete_volume" :: waited 0.008s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[989221e8-4cea-41fb-a3ec-b8243b095ee5]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:44 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:44 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb Apr 14 03:57:44 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:45 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" returned: 0 in 0.457s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:45 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb Apr 14 03:57:45 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:45 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" returned: 0 in 0.396s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb" released by "delete_volume" :: held 0.895s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Created reservations ['042a85eb-d6be-4588-9342-2d86d779534f', 'ffb907a1-43fb-45ac-82bf-97f2ffb08481', '8c0ec798-06f6-4fd5-9fa4-40a30515e9c2', '40ac28f7-c0fa-4972-9530-af639549e54d'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:45 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:45 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-af0599dc-052b-4fe5-b88b-294ff42e9c0c-delete_volume" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-af0599dc-052b-4fe5-b88b-294ff42e9c0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:45 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "cinder-quobyte-af0599dc-052b-4fe5-b88b-294ff42e9c0c" by "delete_volume" {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-af0599dc-052b-4fe5-b88b-294ff42e9c0c" acquired by "delete_volume" :: waited 0.007s {{(pid=82370) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297dbac-67b9-4b67-84ab-3e585807a4aa]: (4, 'qcow2') {{(pid=83434) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:46 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c Apr 14 03:57:46 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:46 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.434s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:46 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Deleted volume successfully. Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-c6b5bde0-47bc-4ef0-a241-69e7da410b40 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-1b3b61dd-33df-4d0b-82a2-ffa1c133cbfb-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:46 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c" returned: 0 in 0.470s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:46 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c Apr 14 03:57:46 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:46 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6/volume-af0599dc-052b-4fe5-b88b-294ff42e9c0c" returned: 0 in 0.410s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-quobyte-af0599dc-052b-4fe5-b88b-294ff42e9c0c" released by "delete_volume" :: held 0.901s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.quota [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Created reservations ['04ddeb2b-0a44-46fc-b114-035fa916b9cb', '7eba01c6-c335-4c70-a3f2-213d99662c56', 'cbd27fe0-732e-439c-ae5a-441646274f4d', 'a55af30c-ab64-4d0c-a7fe-81f7ef3da43e'] {{(pid=82370) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2': None} {{(pid=82370) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG cinder.volume.drivers.quobyte [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e3f7627f-5495-4b45-aae5-776528e0f4f2'] {{(pid=82370) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82370) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:57:46 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:57:46 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6 Apr 14 03:57:46 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:57:47 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Apr 14 03:57:47 devstack cinder-volume[82370]: DEBUG oslo_concurrency.processutils [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d1d8b2b65e76d683cf533cd7d93f60a6" returned: 0 in 0.451s {{(pid=82370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:57:47 devstack cinder-volume[82370]: DEBUG cinder.manager [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Notifying Schedulers of capabilities ... {{(pid=82370) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:57:47 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Deleted volume successfully. Apr 14 03:57:47 devstack cinder-volume[82370]: DEBUG cinder.coordination [None req-839a60b4-3ded-44e9-8cb4-9746fbf12c68 tempest-CinderUnicodeTest-2049066884 None] Lock "cinder-af0599dc-052b-4fe5-b88b-294ff42e9c0c-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82370) __release /opt/stack/cinder/cinder/coordination.py:152}}